Nov 05 08:15:21 devstack cinder-volume[76076]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:15:21 devstack cinder-volume[76076]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:15:21 devstack cinder-volume[76076]: we strongly recommend against using it for new projects. Nov 05 08:15:21 devstack cinder-volume[76076]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:15:21 devstack cinder-volume[76076]: framework. For more detail see Nov 05 08:15:21 devstack cinder-volume[76076]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:15:21 devstack cinder-volume[76076]: import eventlet # noqa Nov 05 08:15:24 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:15:24 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:15:24 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:15:25 devstack cinder-volume[76076]: INFO dbcounter [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Registered counter for database cinder Nov 05 08:15:25 devstack cinder-volume[76076]: DEBUG oslo_db.sqlalchemy.engines [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:25 devstack cinder-volume[76076]: DEBUG dbcounter [-] [76076] Writer thread running {{(pid=76076) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:15:25 devstack cinder-volume[76076]: INFO cinder.rpc [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:15:25 devstack cinder-volume[76076]: INFO cinder.rpc [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:15:25 devstack cinder-volume[76076]: DEBUG oslo_db.sqlalchemy.engines [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:26 devstack cinder-volume[76076]: INFO cinder.volume.manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Determined volume DB was empty at startup. Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG cinder.volume.manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76076) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:15:26 devstack cinder-volume[76076]: INFO cinder.volume.manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 08:15:26 devstack cinder-volume[76076]: WARNING stevedore.named [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:15:26 devstack cinder-volume[76076]: WARNING castellan.key_manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:26 devstack cinder-volume[76076]: WARNING cinder.keymgr.conf_key_mgr [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG cinder.volume.drivers.lvm [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76076) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_concurrency.processutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76076) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_concurrency.processutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] CMD "cinder-rtstool verify" returned: 0 in 0.393s {{(pid=76076) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_db.sqlalchemy.engines [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:26 devstack cinder-volume[76076]: INFO cinder.rpc [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 08:15:26 devstack cinder-volume[76076]: INFO cinder.rpc [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 08:15:26 devstack cinder-volume[76076]: WARNING stevedore.named [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:15:26 devstack cinder-volume[76076]: WARNING castellan.key_manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:26 devstack cinder-volume[76076]: INFO cinder.volume.manager [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_db.sqlalchemy.engines [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:26 devstack cinder-volume[76076]: INFO oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Starting 1 workers Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Started child 76210 {{(pid=76076) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Full set of CONF: {{(pid=76076) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] ******************************************************************************** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Configuration options gathered from: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] ================================================================================ {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] allow_availability_zone_fallback = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] allow_compression_on_image_upload = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] allowed_direct_url_schemes = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] api_rate_limit = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] auth_strategy = keystone {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] az_cache_duration = 3600 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_availability_zone = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76210]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_host = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_stats_polling_interval = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backup_api_class = cinder.backup.api.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backup_name_template = backup-%s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backup_use_same_host = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backup_use_temp_snapshot = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] chap_password = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] chap_username = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_internal_tenant_project_id = 94060fe7ef074e3090eb0cf09c14cf5b {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_internal_tenant_user_id = 2cdeb0cd41cf4c74945642210f838287 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cloned_volume_same_az = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cluster = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] compression_format = gzip {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] compute_api_class = cinder.compute.nova.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] config_dir = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] config_source = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] control_exchange = openstack {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] debug = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] default_availability_zone = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] default_group_type = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] default_volume_type = lvmdriver-1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] disk_geometry = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_client_cert = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_client_cert_key = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_data_namespace = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_ssl_cert_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_ssl_cert_verify = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] driver_use_ssl = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] enable_force_upload = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] enable_new_services = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] enable_unsupported_driver = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] enabled_backends = ['lvmdriver-1'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] enforce_multipath_for_image_xfer = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] filter_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_api_insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_api_ssl_compression = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_ca_certificates_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_catalog_info = image:glance:publicURL {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_num_retries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance_request_timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] goodness_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] graceful_shutdown_timeout = 5 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] group_api_class = cinder.group.api.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] host = devstack {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_compress_on_upload = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_conversion_address_space_limit = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_conversion_cpu_limit = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_conversion_disable = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_introspection_address_space_limit = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_introspection_cpu_limit = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_upload_use_cinder_backend = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_upload_use_internal_tenant = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_volume_cache_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_volume_cache_max_count = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] image_volume_cache_max_size_gb = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] init_host_max_objects_retrieval = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] instance_format = [instance: %(uuid)s] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iscsi_target_flags = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iscsi_write_cache = on {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iser_helper = tgtadm {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iser_ip_address = 192.168.122.181 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iser_port = 3260 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_color = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_config_append = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_dir = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_options = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_rotate_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_rotate_interval_type = days {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] log_rotation_type = none {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] max_age = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] max_logfile_count = 30 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] max_logfile_size_mb = 200 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] max_over_subscription_ratio = 20.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] message_reap_interval = 86400 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] message_ttl = 2592000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] migration_create_volume_timeout_secs = 300 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] monkey_patch = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] monkey_patch_modules = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] my_ip = 192.168.122.181 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] no_snapshot_gb_quota = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] num_iser_scan_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] num_shell_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] num_volume_device_scan_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] nvmeof_conn_info_version = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] nvmet_ns_id = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] nvmet_port_id = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_max_limit = 1000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_ext_list = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_listen = 0.0.0.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_listen_port = 8776 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_use_ssl = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] osapi_volume_workers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] per_volume_size_limit = -1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] periodic_fuzzy_delay = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] periodic_interval = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] project_id_regex = [0-9a-f\-]+ {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] public_endpoint = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] publish_errors = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_backup_gigabytes = 1000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_backups = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_gigabytes = 1000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_groups = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_snapshots = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] quota_volumes = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] rate_limit_burst = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] rate_limit_except_level = CRITICAL {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] rate_limit_interval = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] reinit_driver_count = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76210]: INFO cinder.volume.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] replication_device = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] report_discard_supported = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] report_interval = 120 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] reservation_clean_interval = 86400 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] reservation_expire = 86400 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] reserved_image_namespaces = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] reserved_percentage = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] rpc_response_timeout = 120 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] run_external_periodic_tasks = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] scst_target_driver = iscsi {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] scst_target_iqn_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_down_time = 720 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] shell_completion = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] snapshot_name_template = snapshot-%s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] snapshot_same_host = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] split_loggers = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] state_path = /opt/stack/data/cinder {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] storage_availability_zone = nova {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] storage_protocol = iSCSI {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] syslog_log_facility = LOG_USER {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_helper = lioadm {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_ip_address = 192.168.122.181 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_port = 3260 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_protocol = iscsi {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] target_secondary_ip_addresses = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] trace_flags = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] transfer_api_class = cinder.transfer.api.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] transport_url = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] until_refresh = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_chap_auth = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_default_quota_class = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_journal = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_json = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_multipath_for_image_xfer = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_stderr = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] use_syslog = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] verify_glance_signatures = enabled {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_api_class = cinder.volume.api.API {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_backend_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_clear = zero {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_clear_ionice = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_clear_size = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_copy_bps_limit = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_dd_blocksize = 1M {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_name_template = volume-%s {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_service_inithost_offload = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volume_usage_audit_period = month {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] zoning_mode = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_concurrency.disable_process_locking = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.auth_section = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.auth_type = password {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.auth_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.cache = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.delay_auth_decision = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.http_connect_timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.include_service_catalog = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.interface = public {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_password = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcache_username = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.region_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.service_token_roles_required = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.service_type = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.token_cache_time = 300 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.backend = dogpile.cache.null {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.backend_argument = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.backend_expiration_time = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.config_prefix = cache.oslo {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.debug_cache_backend = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.enable_retry_client = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.enable_socket_keepalive = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.expiration_time = 600 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.hashclient_retry_attempts = 2 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_dead_retry = 300 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_pool_maxsize = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_sasl_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.password = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.proxies = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.redis_db = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.redis_sentinel_service_name = mymaster {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.redis_server = localhost:6379 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.retry_attempts = 2 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.retry_delay = 0.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.socket_keepalive_count = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.socket_keepalive_idle = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.socket_keepalive_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.socket_timeout = 1.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.tls_allowed_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.tls_cafile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.tls_certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.tls_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.tls_keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cache.username = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] coordination.backend_url = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.asyncio_connection = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.asyncio_slave_connection = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.backend = sqlalchemy {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.connection = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.connection_debug = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.connection_parameters = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.connection_recycle_time = 3600 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.connection_trace = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.db_inc_retry_interval = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.db_max_retries = 20 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.db_max_retry_interval = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.db_retry_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.max_overflow = 50 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.max_pool_size = 5 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.max_retries = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.mysql_wsrep_sync_wait = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.pool_timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.retry_interval = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.slave_connection = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.sqlite_synchronous = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.synchronous_reader = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] database.use_db_reconnect = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_tracing.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.connection_string = messaging:// {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.es_doc_type = notification {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.es_scroll_size = 10000 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.es_scroll_time = 2m {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.filter_error_trace = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.hmac_keys = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.sentinel_service_name = mymaster {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.socket_timeout = 0.1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.trace_requests = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler.trace_sqlalchemy = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler_jaeger.process_tags = {} {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler_jaeger.service_name_prefix = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] profiler_otlp.service_name_prefix = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.enforce_new_defaults = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.policy_default_rule = default {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.policy_file = policy.yaml {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_policy.remote_timeout = 60.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.group = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack sudo[76215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.helper_command = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] privsep_osbrick.user = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack sudo[76215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.group = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.helper_command = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] cinder_sys_admin.user = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.auth_section = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.auth_type = password {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.cafile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.collect_timing = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.send_service_user_token = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.split_loggers = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.tls_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] service_user.tls_min_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.auth_section = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.auth_type = password {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.collect_timing = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.region_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.split_loggers = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.tls_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] glance.tls_min_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.backend_availability_zone = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.chap_password = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.chap_username = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.disk_geometry = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_client_cert = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_client_cert_key = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_data_namespace = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.driver_use_ssl = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.enable_unsupported_driver = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.extra_capabilities = {} {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.filter_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.goodness_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iscsi_target_flags = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iscsi_write_cache = on {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iser_helper = tgtadm {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iser_port = 3260 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.lvm_mirrors = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.lvm_share_target = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.lvm_type = auto {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.num_shell_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.nvmet_port_id = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.replication_device = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.report_discard_supported = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.reserved_percentage = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.scst_target_driver = iscsi {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.scst_target_iqn_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.storage_protocol = iSCSI {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_helper = tgtadm {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_port = 3260 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:26 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_protocol = iscsi {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.trace_flags = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.unique_fqdn_network = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.use_chap_auth = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_backend_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_clear = zero {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_clear_ionice = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_clear_size = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volume_group = cinder-volumes {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_reports.file_event_handler = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_reports.log_dir = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.backend_availability_zone = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.backend_host = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.chap_password = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.chap_username = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.chiscsi_conf = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.disk_geometry = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_client_cert = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_data_namespace = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:26 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.driver_use_ssl = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.extra_capabilities = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.filter_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.goodness_function = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iser_helper = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iser_ip_address = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iser_port = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.iser_target_prefix = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.lvm_conf_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.lvm_mirrors = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.lvm_share_target = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.lvm_type = auto {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.num_shell_tries = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.nvmet_port_id = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.replication_device = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.report_discard_supported = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.reserved_percentage = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.scst_target_driver = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.storage_protocol = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_helper = lioadm {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_ip_address = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_port = 3260 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_protocol = iscsi {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.trace_flags = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.use_chap_auth = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_clear = zero {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_clear_size = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] lvmdriver-1.volumes_dir = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.ssl_version = {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_notifications.driver = [] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_notifications.retry = -1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] oslo_messaging_notifications.transport_url = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] key_manager.fixed_key = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.barbican_api_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.barbican_endpoint = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.barbican_endpoint_type = public {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.barbican_region_name = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.cafile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.collect_timing = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.number_of_retries = 60 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.retry_delay = 1 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.send_service_user_token = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.split_loggers = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.tls_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.tls_min_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.verify_ssl = True {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican.verify_ssl_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.auth_section = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.auth_type = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.cafile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.certfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.collect_timing = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.insecure = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.keyfile = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.split_loggers = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.timeout = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.tls_ciphers = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] barbican_service_user.tls_min_version = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.approle_role_id = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.approle_secret_id = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.auth_method = approle {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.auth_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.kv_mountpoint = secret {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.kv_path = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.kv_version = 2 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.namespace = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.root_token_id = **** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.ssl_ca_crt_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.timeout = 60.0 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.token_file = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.token_role = None {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.use_ssl = False {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:27 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] ******************************************************************************** {{(pid=76076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:15:27 devstack sudo[76215]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:27 devstack sudo[76225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:27 devstack sudo[76225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:27 devstack sudo[76225]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:15:27 devstack cinder-volume[76210]: INFO cinder.brick.local_dev.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:27 devstack sudo[76311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:27 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:27 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG cinder.brick.local_dev.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76210) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 08:15:27 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:27 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:27 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:28 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:28 devstack sudo[76612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:28 devstack sudo[76612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:28 devstack sudo[76612]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:28 devstack sudo[76700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 08:15:28 devstack sudo[76700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:28 devstack sudo[76700]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:28 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:28 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:28 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:29 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:29 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:29 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:29 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:29 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:29 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:29 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:29 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:29 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:29 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:29 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:30 devstack sudo[76932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:30 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:30 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:30 devstack cinder-volume[76210]: INFO cinder.volume.drivers.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:30 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:30 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:30 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:30 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:30 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:30 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:30 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:30 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:30 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:31 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:31 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:31 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:31 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:31 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:31 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:31 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:31 devstack cinder-volume[76210]: INFO cinder.volume.driver [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG cinder.volume.driver [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76210) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writer thread running {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG cinder.db.api [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Building query based on filter {{(pid=76210) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG cinder.image.image_utils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76210) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:15:31 devstack cinder-volume[76210]: INFO cinder.keymgr.migration [None req-c0f9f158-9d03-47c1-a2f9-55f53ea64ad2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:31 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:31 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:31 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:31 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:32 devstack sudo[77041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:32 devstack sudo[77041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:32 devstack sudo[77041]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:32 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:32 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:32 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:32 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:32 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:32 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG cinder.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Notifying Schedulers of capabilities ... {{(pid=76210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:15:32 devstack cinder-volume[76210]: INFO cinder.volume.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Driver initialization completed successfully. Nov 05 08:15:32 devstack cinder-volume[76210]: INFO cinder.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Initiating service 2 cleanup Nov 05 08:15:32 devstack cinder-volume[76210]: INFO cinder.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Service 2 cleanup completed. Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG cinder.service [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Creating RPC server for service cinder-volume {{(pid=76210) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG cinder.service [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76210) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:15:32 devstack cinder-volume[76210]: INFO cinder.volume.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:32 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:33 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:33 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:33 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:33 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:33 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:33 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:33 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:33 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:33 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:33 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:33 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:33 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:34 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:34 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:34 devstack cinder-volume[76210]: INFO cinder.volume.manager [None req-6d6d16d5-9ce9-45f1-9a78-25f03f0a5d78 None None] Driver post RPC initialization completed successfully. Nov 05 08:15:36 devstack cinder-volume[76076]: DEBUG dbcounter [-] [76076] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76076) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:44 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager._thread_info {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:15:44 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread count: 6 {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:15:44 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread info: [<_MainThread(MainThread, started 127069611409536)>, , , , , ] {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:44 devstack sudo[79430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:16:44 devstack sudo[79430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:44 devstack sudo[79430]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:44 devstack sudo[79557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:16:44 devstack sudo[79557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:44 devstack sudo[79557]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:44 devstack sudo[79565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:16:44 devstack sudo[79565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:45 devstack sudo[79565]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:45 devstack sudo[79568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:16:45 devstack sudo[79568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:45 devstack sudo[79568]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG cinder.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Notifying Schedulers of capabilities ... {{(pid=76210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager._thread_info {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread count: 6 {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:16:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread info: [<_MainThread(MainThread, started 127069611409536)>, , , , , ] {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:SELECT=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:UPDATE=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:44 devstack sudo[82573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:17:44 devstack sudo[82573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:44 devstack sudo[82573]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:44 devstack sudo[82577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:17:44 devstack sudo[82577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:44 devstack sudo[82577]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:44 devstack sudo[82580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:17:44 devstack sudo[82580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:45 devstack sudo[82580]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:45 devstack sudo[82584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:17:45 devstack sudo[82584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:45 devstack sudo[82584]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:45 devstack cinder-volume[76210]: DEBUG cinder.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Notifying Schedulers of capabilities ... {{(pid=76210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:44 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:18:44 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:44 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:44 devstack sudo[84763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:18:44 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:44 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:44 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:18:44 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:44 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:45 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:18:45 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:45 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:45 devstack cinder-volume[76210]: DEBUG cinder.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Notifying Schedulers of capabilities ... {{(pid=76210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:18:45 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager._thread_info {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:18:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread count: 6 {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:18:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread info: [<_MainThread(MainThread, started 127069611409536)>, , , , , ] {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:SELECT=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG dbcounter [-] [76210] Writing DB stats cinder:UPDATE=1 {{(pid=76210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG cinder.volume.drivers.lvm [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Updating volume stats {{(pid=76210) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:44 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:19:44 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:44 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:44 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:19:44 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:44 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:44 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:19:44 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:44 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:44 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:45 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:19:45 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:45 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:45 devstack cinder-volume[76210]: DEBUG oslo_concurrency.processutils [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:45 devstack cinder-volume[76210]: DEBUG cinder.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Notifying Schedulers of capabilities ... {{(pid=76210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:19:45 devstack cinder-volume[76210]: DEBUG oslo_service.periodic_task [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] Running periodic task VolumeManager._thread_info {{(pid=76210) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:19:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread count: 6 {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:19:45 devstack cinder-volume[76210]: DEBUG cinder.volume.manager [None req-105b7399-cd2b-4335-ba02-54edc7f9e737 None None] thread info: [<_MainThread(MainThread, started 127069611409536)>, , , , , ] {{(pid=76210) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:19:52 devstack cinder-volume[76076]: INFO oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Caught SIGTERM, stopping children Nov 05 08:19:52 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Acquiring lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:52 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Acquired lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:52 devstack cinder-volume[76076]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Releasing lock "singleton_lock" {{(pid=76076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:52 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Stop services. {{(pid=76076) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 08:19:52 devstack cinder-volume[76076]: DEBUG oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Killing children. {{(pid=76076) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 08:19:52 devstack cinder-volume[76076]: INFO oslo_service.backend._eventlet.service [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Waiting on 1 children to exit Nov 05 08:19:57 devstack cinder-volume[76210]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 05 08:19:57 devstack cinder-volume[76210]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Acquiring lock "singleton_lock" {{(pid=76210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:57 devstack cinder-volume[76210]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Acquired lock "singleton_lock" {{(pid=76210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:57 devstack cinder-volume[76210]: DEBUG oslo_concurrency.lockutils [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Releasing lock "singleton_lock" {{(pid=76210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:57 devstack cinder-volume[76210]: WARNING amqp [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:57 devstack cinder-volume[76210]: WARNING amqp [None req-82a0260d-b486-49d2-9ce6-743c74901aec None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:58 devstack cinder-volume[86272]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:19:58 devstack cinder-volume[86272]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:19:58 devstack cinder-volume[86272]: we strongly recommend against using it for new projects. Nov 05 08:19:58 devstack cinder-volume[86272]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:19:58 devstack cinder-volume[86272]: framework. For more detail see Nov 05 08:19:58 devstack cinder-volume[86272]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:19:58 devstack cinder-volume[86272]: import eventlet # noqa Nov 05 08:20:00 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:20:00 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:20:00 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:20:00 devstack cinder-volume[86272]: INFO dbcounter [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Registered counter for database cinder Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_db.sqlalchemy.engines [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG dbcounter [-] [86272] Writer thread running {{(pid=86272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:01 devstack cinder-volume[86272]: INFO cinder.rpc [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:20:01 devstack cinder-volume[86272]: INFO cinder.rpc [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_db.sqlalchemy.engines [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:01 devstack cinder-volume[86272]: INFO cinder.volume.manager [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Determined volume DB was empty at startup. Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG cinder.volume.manager [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86272) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:20:01 devstack cinder-volume[86272]: INFO cinder.volume.manager [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 08:20:01 devstack cinder-volume[86272]: WARNING stevedore.named [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:20:01 devstack cinder-volume[86272]: WARNING castellan.key_manager [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:01 devstack cinder-volume[86272]: WARNING cinder.keymgr.conf_key_mgr [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:01 devstack cinder-volume[86272]: INFO cinder.volume.manager [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_db.sqlalchemy.engines [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:01 devstack cinder-volume[86272]: INFO oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Starting 1 workers Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Started child 86492 {{(pid=86272) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Full set of CONF: {{(pid=86272) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] ******************************************************************************** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Configuration options gathered from: {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] ================================================================================ {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] allow_availability_zone_fallback = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86492]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] allow_compression_on_image_upload = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] allowed_direct_url_schemes = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] api_rate_limit = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] auth_strategy = keystone {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_availability_zone = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_host = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_stats_polling_interval = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backup_api_class = cinder.backup.api.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backup_name_template = backup-%s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backup_use_same_host = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backup_use_temp_snapshot = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] chap_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] chap_username = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_internal_tenant_project_id = 94060fe7ef074e3090eb0cf09c14cf5b {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_internal_tenant_user_id = 2cdeb0cd41cf4c74945642210f838287 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cluster = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] compression_format = gzip {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] config_dir = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] config_source = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] control_exchange = openstack {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] debug = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] default_availability_zone = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] default_group_type = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] default_volume_type = QuobyteHD {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] disk_geometry = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_client_cert = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_client_cert_key = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_data_namespace = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_ssl_cert_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_ssl_cert_verify = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] driver_use_ssl = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] enable_new_services = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] enable_unsupported_driver = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] enforce_multipath_for_image_xfer = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] filter_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_api_insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_api_ssl_compression = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_ca_certificates_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_num_retries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance_request_timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] goodness_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] graceful_shutdown_timeout = 5 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] group_api_class = cinder.group.api.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] host = devstack {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_compress_on_upload = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_conversion_address_space_limit = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_conversion_cpu_limit = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_conversion_disable = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_introspection_address_space_limit = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_introspection_cpu_limit = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_upload_use_cinder_backend = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_upload_use_internal_tenant = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_volume_cache_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_volume_cache_max_count = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] init_host_max_objects_retrieval = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] instance_format = [instance: %(uuid)s] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iscsi_target_flags = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iscsi_write_cache = on {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iser_helper = tgtadm {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iser_ip_address = 192.168.122.181 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iser_port = 3260 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_color = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_config_append = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_dir = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_options = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_rotate_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_rotate_interval_type = days {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] log_rotation_type = none {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] max_age = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] max_logfile_count = 30 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.remotefs [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86492) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] max_logfile_size_mb = 200 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] max_over_subscription_ratio = 20.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] message_reap_interval = 86400 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] message_ttl = 2592000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] monkey_patch = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] monkey_patch_modules = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] my_ip = 192.168.122.181 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] no_snapshot_gb_quota = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] num_iser_scan_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] num_shell_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] num_volume_device_scan_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] nvmeof_conn_info_version = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] nvmet_ns_id = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] nvmet_port_id = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_max_limit = 1000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_ext_list = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_listen_port = 8776 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_use_ssl = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] osapi_volume_workers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] per_volume_size_limit = -1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] periodic_fuzzy_delay = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] periodic_interval = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] public_endpoint = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] publish_errors = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_backup_gigabytes = 1000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_backups = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_gigabytes = 1000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_groups = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_snapshots = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] quota_volumes = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] rate_limit_burst = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] rate_limit_except_level = CRITICAL {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] rate_limit_interval = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] reinit_driver_count = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] replication_device = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] report_discard_supported = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] report_interval = 120 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] reservation_clean_interval = 86400 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] reservation_expire = 86400 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] reserved_image_namespaces = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] reserved_percentage = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] rpc_response_timeout = 120 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] run_external_periodic_tasks = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] scst_target_driver = iscsi {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] scst_target_iqn_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_down_time = 720 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] shell_completion = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] snapshot_name_template = snapshot-%s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] split_loggers = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] state_path = /opt/stack/data/cinder {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] storage_availability_zone = nova {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] storage_protocol = iSCSI {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] syslog_log_facility = LOG_USER {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_helper = lioadm {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_ip_address = 192.168.122.181 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_port = 3260 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_protocol = iscsi {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] target_secondary_ip_addresses = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] trace_flags = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] transport_url = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] until_refresh = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_chap_auth = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_default_quota_class = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_journal = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_json = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_multipath_for_image_xfer = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_stderr = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] use_syslog = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] verify_glance_signatures = enabled {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_api_class = cinder.volume.api.API {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_backend_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_clear = zero {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_clear_ionice = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_clear_size = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_copy_bps_limit = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_dd_blocksize = 1M {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_name_template = volume-%s {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_service_inithost_offload = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volume_usage_audit_period = month {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] zoning_mode = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.auth_section = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.auth_type = password {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.auth_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.cache = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.interface = public {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcache_username = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.region_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.service_type = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.backend = dogpile.cache.null {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.backend_argument = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.backend_expiration_time = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.config_prefix = cache.oslo {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.debug_cache_backend = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.enable_retry_client = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.enable_socket_keepalive = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.expiration_time = 600 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_dead_retry = 300 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_sasl_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.proxies = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.redis_db = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.redis_server = localhost:6379 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.retry_attempts = 2 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.retry_delay = 0.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.socket_keepalive_count = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.socket_keepalive_idle = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.socket_keepalive_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.socket_timeout = 1.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.tls_allowed_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.tls_cafile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.tls_certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.tls_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.tls_keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cache.username = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] coordination.backend_url = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.asyncio_connection = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.asyncio_slave_connection = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.backend = sqlalchemy {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.connection = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.connection_debug = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.connection_parameters = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.connection_recycle_time = 3600 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.connection_trace = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.db_inc_retry_interval = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.db_max_retries = 20 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.db_max_retry_interval = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.db_retry_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.max_overflow = 50 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.max_pool_size = 5 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.max_retries = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.pool_timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.retry_interval = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.slave_connection = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.sqlite_synchronous = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.synchronous_reader = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] database.use_db_reconnect = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_tracing.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.connection_string = messaging:// {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.es_doc_type = notification {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.es_scroll_size = 10000 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.es_scroll_time = 2m {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.filter_error_trace = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.hmac_keys = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.sentinel_service_name = mymaster {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.socket_timeout = 0.1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.trace_requests = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86492) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 08:20:01 devstack cinder-volume[86492]: WARNING cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 08:20:01 devstack cinder-volume[86492]: WARNING cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler.trace_sqlalchemy = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler_jaeger.process_tags = {} {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] profiler_otlp.service_name_prefix = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.policy_default_rule = default {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.group = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.helper_command = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] privsep_osbrick.user = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.group = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.helper_command = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] cinder_sys_admin.user = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.auth_section = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.auth_type = password {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.cafile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.collect_timing = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.send_service_user_token = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.split_loggers = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.tls_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] service_user.tls_min_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.auth_section = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.auth_type = password {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.collect_timing = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.region_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.split_loggers = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.tls_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] glance.tls_min_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.backend_availability_zone = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.chap_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.chap_username = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.disk_geometry = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_client_cert = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_data_namespace = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.driver_use_ssl = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.extra_capabilities = {} {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.filter_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.goodness_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iscsi_target_flags = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iser_port = 3260 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_host = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_login = admin {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_mount_options = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_private_key = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_share_path = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.replication_device = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.report_discard_supported = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_helper = tgtadm {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_port = 3260 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_protocol = iscsi {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.trace_flags = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.use_chap_auth = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_backend_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_clear = zero {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_reports.file_event_handler = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_reports.log_dir = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.backend_host = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.chap_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.chap_username = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.disk_geometry = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_client_cert = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.extra_capabilities = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.filter_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.goodness_function = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iser_helper = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iser_ip_address = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iser_port = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_host = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_login = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_mount_options = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_password = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_private_key = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_share_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.num_shell_tries = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.replication_device = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.report_discard_supported = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.reserved_percentage = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.scst_target_driver = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.storage_protocol = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_helper = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_ip_address = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_port = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_prefix = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_protocol = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.trace_flags = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.use_chap_auth = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_clear = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_clear_size = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] QuobyteHD.volumes_dir = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=86492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: INFO cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 ... Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 -c /etc/quobyte/client-cinder.cfg {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_notifications.driver = [] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] key_manager.fixed_key = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.barbican_api_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.barbican_endpoint = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.barbican_endpoint_type = public {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.barbican_region_name = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.cafile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.collect_timing = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.number_of_retries = 60 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.retry_delay = 1 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.send_service_user_token = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.split_loggers = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.tls_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.tls_min_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.verify_ssl = True {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican.verify_ssl_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.auth_section = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 -c /etc/quobyte/client-cinder.cfg Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.auth_type = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.cafile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.certfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.collect_timing = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.insecure = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.keyfile = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.split_loggers = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.timeout = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.tls_ciphers = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] barbican_service_user.tls_min_version = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.approle_role_id = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.approle_secret_id = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.auth_method = approle {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.auth_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.kv_mountpoint = secret {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.kv_path = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.kv_version = 2 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.namespace = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.root_token_id = **** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.ssl_ca_crt_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.timeout = 60.0 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.token_file = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.token_role = None {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.use_ssl = False {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:02 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] ******************************************************************************** {{(pid=86272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:20:02 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.401s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:02 devstack cinder-volume[86492]: INFO cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 succeeded Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=86492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.418s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:02 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:02 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:02 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.235s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:02 devstack cinder-volume[86492]: INFO cinder.volume.driver [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.volume.driver [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86492) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_db.sqlalchemy.engines [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86492) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG dbcounter [-] [86492] Writer thread running {{(pid=86492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.db.api [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Building query based on filter {{(pid=86492) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.image.image_utils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86492) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:20:02 devstack cinder-volume[86492]: INFO cinder.keymgr.migration [None req-397bdcc6-880e-405e-a02c-55b807b11de3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=86492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=86492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:02 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:02 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:02 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:02 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.229s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG cinder.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Notifying Schedulers of capabilities ... {{(pid=86492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:20:03 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Driver initialization completed successfully. Nov 05 08:20:03 devstack cinder-volume[86492]: INFO cinder.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Initiating service 3 cleanup Nov 05 08:20:03 devstack cinder-volume[86492]: INFO cinder.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Service 3 cleanup completed. Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG cinder.service [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Creating RPC server for service cinder-volume {{(pid=86492) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG cinder.service [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86492) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:20:03 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=86492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=86492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:03 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:03 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:03 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:03 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.238s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:03 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-b7efc320-db56-4bf0-b26d-ffcbda1478c4 None None] Driver post RPC initialization completed successfully. Nov 05 08:20:07 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:07 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:07 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=86492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:08 devstack cinder-volume[86492]: DEBUG cinder.volume.drivers.quobyte [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=86492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:08 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:08 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:08 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:08 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:08 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:08 devstack cinder-volume[86492]: DEBUG oslo_concurrency.processutils [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.242s {{(pid=86492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:08 devstack cinder-volume[86492]: DEBUG cinder.manager [None req-13d9bedc-f375-4f56-bf12-74dcef69d1c4 None None] Notifying Schedulers of capabilities ... {{(pid=86492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:20:08 devstack cinder-volume[86272]: INFO oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Caught SIGTERM, stopping children Nov 05 08:20:08 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Acquiring lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:20:08 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Acquired lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:20:08 devstack cinder-volume[86272]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Releasing lock "singleton_lock" {{(pid=86272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:20:08 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Stop services. {{(pid=86272) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 08:20:08 devstack cinder-volume[86272]: DEBUG oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Killing children. {{(pid=86272) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 08:20:08 devstack cinder-volume[86272]: INFO oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Waiting on 1 children to exit Nov 05 08:20:11 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Acquiring lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:20:11 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Acquired lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:20:11 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Releasing lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:20:11 devstack cinder-volume[86492]: WARNING amqp [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:20:11 devstack cinder-volume[86492]: WARNING amqp [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:20:11 devstack cinder-volume[86272]: INFO oslo_service.backend._eventlet.service [None req-5d501013-6e39-476a-9db4-41ee8421aba9 None None] Child 86492 exited with status 0 Nov 05 08:20:12 devstack cinder-volume[86809]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:20:12 devstack cinder-volume[86809]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:20:12 devstack cinder-volume[86809]: we strongly recommend against using it for new projects. Nov 05 08:20:12 devstack cinder-volume[86809]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:20:12 devstack cinder-volume[86809]: framework. For more detail see Nov 05 08:20:12 devstack cinder-volume[86809]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:20:12 devstack cinder-volume[86809]: import eventlet # noqa Nov 05 08:20:14 devstack cinder-volume[86809]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86809) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:20:14 devstack cinder-volume[86809]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86809) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:20:14 devstack cinder-volume[86809]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86809) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:20:15 devstack cinder-volume[86809]: INFO dbcounter [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Registered counter for database cinder Nov 05 08:20:15 devstack cinder-volume[86809]: DEBUG oslo_db.sqlalchemy.engines [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86809) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:15 devstack cinder-volume[86809]: DEBUG dbcounter [-] [86809] Writer thread running {{(pid=86809) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:15 devstack cinder-volume[86809]: INFO cinder.rpc [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:20:15 devstack cinder-volume[86809]: INFO cinder.rpc [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_db.sqlalchemy.engines [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86809) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:16 devstack cinder-volume[86809]: INFO cinder.volume.manager [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Determined volume DB was empty at startup. Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG cinder.volume.manager [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86809) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:20:16 devstack cinder-volume[86809]: WARNING stevedore.named [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:20:16 devstack cinder-volume[86809]: WARNING castellan.key_manager [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:16 devstack cinder-volume[86809]: WARNING cinder.keymgr.conf_key_mgr [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:16 devstack cinder-volume[86809]: INFO cinder.volume.manager [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_db.sqlalchemy.engines [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86809) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:16 devstack cinder-volume[86809]: INFO oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Starting 1 workers Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Started child 87101 {{(pid=86809) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Full set of CONF: {{(pid=86809) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] ******************************************************************************** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] Configuration options gathered from: {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] ================================================================================ {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] allow_availability_zone_fallback = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] allow_compression_on_image_upload = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[87101]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] allowed_direct_url_schemes = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] api_rate_limit = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] auth_strategy = keystone {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_availability_zone = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_host = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_stats_polling_interval = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backup_api_class = cinder.backup.api.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backup_name_template = backup-%s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backup_use_same_host = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backup_use_temp_snapshot = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] chap_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] chap_username = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_internal_tenant_project_id = 94060fe7ef074e3090eb0cf09c14cf5b {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_internal_tenant_user_id = 2cdeb0cd41cf4c74945642210f838287 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cluster = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] compression_format = gzip {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] compute_api_class = cinder.compute.nova.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] config_dir = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] config_source = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] control_exchange = openstack {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] debug = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] default_availability_zone = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] default_group_type = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] default_volume_type = QuobyteHD {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] disk_geometry = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_client_cert = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_client_cert_key = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_data_namespace = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_ssl_cert_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_ssl_cert_verify = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] driver_use_ssl = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] enable_new_services = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] enable_unsupported_driver = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] enabled_backends = ['QuobyteHD'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] enforce_multipath_for_image_xfer = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] filter_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_api_insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_api_ssl_compression = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_ca_certificates_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_catalog_info = image:glance:publicURL {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_num_retries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance_request_timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] goodness_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] graceful_shutdown_timeout = 5 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] group_api_class = cinder.group.api.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] host = devstack {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_compress_on_upload = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_conversion_address_space_limit = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_conversion_cpu_limit = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_conversion_disable = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_introspection_address_space_limit = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_introspection_cpu_limit = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_upload_use_cinder_backend = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_upload_use_internal_tenant = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_volume_cache_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_volume_cache_max_count = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] image_volume_cache_max_size_gb = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] init_host_max_objects_retrieval = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] instance_format = [instance: %(uuid)s] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iscsi_target_flags = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iscsi_write_cache = on {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iser_helper = tgtadm {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iser_ip_address = 192.168.122.181 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iser_port = 3260 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_color = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_config_append = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_dir = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_options = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_rotate_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_rotate_interval_type = days {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] log_rotation_type = none {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] max_age = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] max_logfile_count = 30 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] max_logfile_size_mb = 200 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87101) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] max_over_subscription_ratio = 20.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] message_reap_interval = 86400 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] message_ttl = 2592000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] migration_create_volume_timeout_secs = 300 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] monkey_patch = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] monkey_patch_modules = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] my_ip = 192.168.122.181 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] no_snapshot_gb_quota = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] num_iser_scan_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] num_shell_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] num_volume_device_scan_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] nvmeof_conn_info_version = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] nvmet_ns_id = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] nvmet_port_id = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_max_limit = 1000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_ext_list = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_listen_port = 8776 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_use_ssl = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] osapi_volume_workers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] per_volume_size_limit = -1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] periodic_fuzzy_delay = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] periodic_interval = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] public_endpoint = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] publish_errors = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_backup_gigabytes = 1000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_backups = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_gigabytes = 1000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_groups = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_snapshots = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] quota_volumes = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] rate_limit_burst = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] rate_limit_except_level = CRITICAL {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] rate_limit_interval = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] reinit_driver_count = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] replication_device = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] report_discard_supported = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] report_interval = 120 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] reservation_clean_interval = 86400 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] reservation_expire = 86400 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] reserved_image_namespaces = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] reserved_percentage = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] rpc_response_timeout = 120 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] run_external_periodic_tasks = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] scst_target_driver = iscsi {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] scst_target_iqn_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_down_time = 720 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] shell_completion = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] snapshot_name_template = snapshot-%s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] split_loggers = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] state_path = /opt/stack/data/cinder {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] storage_availability_zone = nova {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] storage_protocol = iSCSI {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] syslog_log_facility = LOG_USER {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_helper = lioadm {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_ip_address = 192.168.122.181 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_port = 3260 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_protocol = iscsi {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] target_secondary_ip_addresses = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] trace_flags = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] transport_url = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] until_refresh = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_chap_auth = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_default_quota_class = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_journal = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_json = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_multipath_for_image_xfer = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_stderr = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] use_syslog = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] verify_glance_signatures = enabled {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_api_class = cinder.volume.api.API {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_backend_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_clear = zero {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_clear_ionice = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_clear_size = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_copy_bps_limit = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_dd_blocksize = 1M {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_name_template = volume-%s {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_service_inithost_offload = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volume_usage_audit_period = month {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] zoning_mode = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_concurrency.disable_process_locking = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.auth_section = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.auth_type = password {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.auth_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.cache = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.include_service_catalog = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.interface = public {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcache_username = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.region_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.service_type = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.backend = dogpile.cache.null {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.backend_argument = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.backend_expiration_time = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.config_prefix = cache.oslo {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.debug_cache_backend = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.enable_retry_client = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.enable_socket_keepalive = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.expiration_time = 600 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.hashclient_retry_attempts = 2 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87101) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_dead_retry = 300 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_pool_maxsize = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_sasl_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.proxies = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.redis_db = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 08:20:16 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.redis_server = localhost:6379 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.retry_attempts = 2 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.retry_delay = 0.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.socket_keepalive_count = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.socket_keepalive_idle = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.socket_keepalive_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.socket_timeout = 1.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.tls_allowed_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.tls_cafile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.tls_certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.tls_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.tls_keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cache.username = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] coordination.backend_url = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.asyncio_connection = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.asyncio_slave_connection = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.backend = sqlalchemy {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.connection = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.connection_debug = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.connection_parameters = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.connection_recycle_time = 3600 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.connection_trace = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.db_inc_retry_interval = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.db_max_retries = 20 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.db_max_retry_interval = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.db_retry_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.max_overflow = 50 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.max_pool_size = 5 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.max_retries = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.mysql_wsrep_sync_wait = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.pool_timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.retry_interval = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.slave_connection = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.sqlite_synchronous = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.synchronous_reader = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] database.use_db_reconnect = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_tracing.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.connection_string = messaging:// {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.es_doc_type = notification {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.es_scroll_size = 10000 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.es_scroll_time = 2m {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.filter_error_trace = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.hmac_keys = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.sentinel_service_name = mymaster {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.socket_timeout = 0.1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.trace_requests = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler.trace_sqlalchemy = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler_jaeger.process_tags = {} {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler_jaeger.service_name_prefix = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] profiler_otlp.service_name_prefix = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.enforce_new_defaults = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.policy_default_rule = default {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.policy_file = policy.yaml {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.group = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.helper_command = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] privsep_osbrick.user = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.group = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.helper_command = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] cinder_sys_admin.user = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.auth_section = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.auth_type = password {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.cafile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.collect_timing = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.send_service_user_token = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.split_loggers = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.tls_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] service_user.tls_min_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.auth_section = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.auth_type = password {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.collect_timing = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.region_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.split_loggers = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.tls_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] glance.tls_min_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.backend_availability_zone = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.chap_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.chap_username = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.disk_geometry = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_client_cert = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_client_cert_key = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_data_namespace = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.driver_use_ssl = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.extra_capabilities = {} {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.filter_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.goodness_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iscsi_target_flags = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iscsi_write_cache = on {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iser_helper = tgtadm {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iser_port = 3260 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_host = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_login = admin {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_mount_options = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_private_key = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_share_path = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_ssh_port = 22 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.num_shell_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.quobyte_volume_url = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.replication_device = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.report_discard_supported = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.reserved_percentage = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_helper = tgtadm {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_port = 3260 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_protocol = iscsi {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.trace_flags = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.unique_fqdn_network = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.use_chap_auth = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_backend_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_clear = zero {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_clear_ionice = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_clear_size = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_reports.file_event_handler = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_reports.log_dir = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.backend_availability_zone = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.backend_host = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.chap_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.chap_username = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.chiscsi_conf = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.disk_geometry = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_client_cert = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_data_namespace = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.driver_use_ssl = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.extra_capabilities = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.filter_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.goodness_function = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iscsi_target_flags = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iscsi_write_cache = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iser_helper = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iser_ip_address = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iser_port = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.iser_target_prefix = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_host = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_login = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_mount_options = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_password = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_private_key = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_share_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_ssh_port = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.num_shell_tries = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nvmet_ns_id = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.nvmet_port_id = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.replication_device = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.report_discard_supported = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.reserved_percentage = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.scst_target_driver = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.storage_protocol = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_helper = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_ip_address = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_port = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_prefix = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_protocol = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.trace_flags = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.unique_fqdn_network = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.use_chap_auth = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_clear = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_clear_ionice = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_clear_size = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] QuobyteHD.volumes_dir = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack quobyte-client[87109]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack quobyte-client[87109]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_notifications.driver = [] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_notifications.retry = -1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] key_manager.fixed_key = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.barbican_api_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.barbican_endpoint = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.barbican_endpoint_type = public {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.barbican_region_name = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.cafile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.collect_timing = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.number_of_retries = 60 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.retry_delay = 1 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.send_service_user_token = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.split_loggers = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.tls_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.tls_min_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.verify_ssl = True {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican.verify_ssl_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.auth_section = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.auth_type = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.cafile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.certfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.collect_timing = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.insecure = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.keyfile = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.split_loggers = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.timeout = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.tls_ciphers = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] barbican_service_user.tls_min_version = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.approle_role_id = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.approle_secret_id = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.auth_method = approle {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.auth_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.kv_mountpoint = secret {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.kv_path = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.kv_version = 2 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.namespace = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.root_token_id = **** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.ssl_ca_crt_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.timeout = 60.0 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.token_file = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.token_role = None {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.use_ssl = False {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:16 devstack cinder-volume[86809]: DEBUG oslo_service.backend._eventlet.service [None req-37952645-2d8d-44a3-a3a3-c4a2275602fd None None] ******************************************************************************** {{(pid=86809) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:20:16 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:16 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:16 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:16 devstack cinder-volume[87101]: INFO cinder.volume.driver [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.driver [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87101) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_db.sqlalchemy.engines [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writer thread running {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.db.api [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Building query based on filter {{(pid=87101) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87101) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:16 devstack cinder-volume[87101]: INFO cinder.keymgr.migration [None req-1b2aedd0-4793-477f-89ee-636db73c3318 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:20:16 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:16 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:17 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.234s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:20:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Driver initialization completed successfully. Nov 05 08:20:17 devstack cinder-volume[87101]: INFO cinder.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Initiating service 3 cleanup Nov 05 08:20:17 devstack cinder-volume[87101]: INFO cinder.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Service 3 cleanup completed. Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG cinder.service [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Creating RPC server for service cinder-volume {{(pid=87101) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG cinder.service [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87101) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:20:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:17 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:20:17 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:17 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-50c5b214-5447-4869-9f2d-f5d11e2b5fd2 None None] Driver post RPC initialization completed successfully. Nov 05 08:20:26 devstack cinder-volume[86809]: DEBUG dbcounter [-] [86809] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86809) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:20:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 6 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:20:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Flow 'volume_create_manager' (1c39bf7c-b66f-416b-99f8-7c4248f91e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcbd41a-fe0e-4f10-a01e-e1bc575156ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcbd41a-fe0e-4f10-a01e-e1bc575156ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-316795564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf8252-df98-4dc9-9086-6b8c730d59bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3dd65534f424ce39307eae0d5db4e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:17Z,use_quota=True,user_id='d2d56379d7094ed49e3f5e28e885b5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ada837-8074-4e3b-adcb-726383b2400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ada837-8074-4e3b-adcb-726383b2400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa03224-e29e-4459-b8ca-4ef693b72713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa03224-e29e-4459-b8ca-4ef693b72713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccf8252-df98-4dc9-9086-6b8c730d59bd', 'volume_name': 'volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508209c-0bc8-4a40-a7c5-5b8c363cf060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508209c-0bc8-4a40-a7c5-5b8c363cf060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f0fcc8-3347-439e-b94c-0528aea6c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Volume 9ccf8252-df98-4dc9-9086-6b8c730d59bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd', 'volume_size': 1} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-316795564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf8252-df98-4dc9-9086-6b8c730d59bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3dd65534f424ce39307eae0d5db4e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:17Z,use_quota=True,user_id='d2d56379d7094ed49e3f5e28e885b5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Creating volume 9ccf8252-df98-4dc9-9086-6b8c730d59bd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:16 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:21:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:16 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd 1073741824 Nov 05 08:21:16 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:17 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd 1073741824" returned: 0 in 0.527s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:17 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd Nov 05 08:21:17 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:17 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd" returned: 0 in 0.375s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f0fcc8-3347-439e-b94c-0528aea6c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5bbf01-a258-43d4-8697-4e18f1e65975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Volume volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd (9ccf8252-df98-4dc9-9086-6b8c730d59bd): created successfully Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5bbf01-a258-43d4-8697-4e18f1e65975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Flow 'volume_create_manager' (1c39bf7c-b66f-416b-99f8-7c4248f91e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b6bc38fa-e9f8-4f9a-945a-b1925a312746 tempest-TaggedAttachmentsTest-597113232 None] Created volume successfully. Nov 05 08:21:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:21:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:48 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:21:48 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:48 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 6 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:21:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Flow 'volume_create_manager' (e8824e86-ea91-46c4-bbd2-44a1ccb94222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b393bd4-9c76-441a-ad79-50c323310707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b393bd4-9c76-441a-ad79-50c323310707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2038167426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e8a32-f679-4a77-8286-48656f0f85fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb61fb9dcef47f59df8d2f1d9bb6020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:50Z,use_quota=True,user_id='e00d8eb1903947bd89fab2bde45c23bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a27c37-ddba-4bef-8f49-cd772a2c0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a27c37-ddba-4bef-8f49-cd772a2c0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a652ea-662e-4f64-b9af-3a68da63b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a652ea-662e-4f64-b9af-3a68da63b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522e8a32-f679-4a77-8286-48656f0f85fe', 'volume_name': 'volume-522e8a32-f679-4a77-8286-48656f0f85fe', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069dd86-e0fc-48b7-af67-4069d9a295cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069dd86-e0fc-48b7-af67-4069d9a295cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33f52cf-9f00-4594-b6bc-4c68be4d831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Volume 522e8a32-f679-4a77-8286-48656f0f85fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522e8a32-f679-4a77-8286-48656f0f85fe', 'volume_size': 1} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2038167426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e8a32-f679-4a77-8286-48656f0f85fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb61fb9dcef47f59df8d2f1d9bb6020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:50Z,use_quota=True,user_id='e00d8eb1903947bd89fab2bde45c23bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Creating volume 522e8a32-f679-4a77-8286-48656f0f85fe {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:50 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:21:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:50 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe 1073741824 Nov 05 08:21:50 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:52 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe 1073741824" returned: 0 in 1.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:52 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe Nov 05 08:21:52 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:52 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe" returned: 0 in 0.776s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33f52cf-9f00-4594-b6bc-4c68be4d831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522e8a32-f679-4a77-8286-48656f0f85fe', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a5b25-e052-4a53-8a0a-b3b935681571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Volume volume-522e8a32-f679-4a77-8286-48656f0f85fe (522e8a32-f679-4a77-8286-48656f0f85fe): created successfully Nov 05 08:21:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a5b25-e052-4a53-8a0a-b3b935681571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Flow 'volume_create_manager' (e8824e86-ea91-46c4-bbd2-44a1ccb94222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1ec00cef-ea4a-4f51-94db-99770cf939c7 tempest-VolumesAdminNegativeTest-1137449810 None] Created volume successfully. Nov 05 08:21:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Acquiring lock "cinder-522e8a32-f679-4a77-8286-48656f0f85fe-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:21:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "cinder-522e8a32-f679-4a77-8286-48656f0f85fe-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:21:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Acquiring lock "cinder-quobyte-522e8a32-f679-4a77-8286-48656f0f85fe" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:21:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "cinder-quobyte-522e8a32-f679-4a77-8286-48656f0f85fe" acquired by "delete_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:21:55 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb17071_v/privsep.sock'] Nov 05 08:21:55 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb17071_v/privsep.sock Nov 05 08:21:55 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 08:21:56 devstack cinder-volume[87101]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 08:21:57 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:57 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Spawned new privsep daemon via rootwrap Nov 05 08:21:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Accepted privsep connection to /tmp/tmpb17071_v/privsep.sock {{(pid=87101) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 08:21:57 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 08:21:57 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 08:21:57 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 08:21:57 devstack cinder-volume[87101]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88399 Nov 05 08:21:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aabb64-2a82-4f34-a85c-f271c7ca88f4]: (2,) {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:21:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c42e758-c845-486a-8e26-7bf44c195592]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:21:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:57 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe Nov 05 08:21:57 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:58 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe" returned: 0 in 0.932s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:58 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe Nov 05 08:21:58 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Flow 'volume_create_manager' (fa1a9de1-80f9-4d04-b64d-30f8a46842d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7404cd78-e47e-42ab-b9af-3f64c7699647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:58 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-522e8a32-f679-4a77-8286-48656f0f85fe" returned: 0 in 0.776s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7404cd78-e47e-42ab-b9af-3f64c7699647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1735909110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1de48ae-bb90-41e2-8e83-1cbc160ec574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe20336c9ec34871b38744555516265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:59Z,use_quota=True,user_id='025fc63e10d5442bafb9937924a85375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745f217-1b54-4519-ad2a-1b1e3a6a6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745f217-1b54-4519-ad2a-1b1e3a6a6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf971ab-19a3-4ca5-99cf-271cead65049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf971ab-19a3-4ca5-99cf-271cead65049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1de48ae-bb90-41e2-8e83-1cbc160ec574', 'volume_name': 'volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02872ae2-60b6-416a-b014-09fa51acde8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02872ae2-60b6-416a-b014-09fa51acde8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6169d5-fe57-4fdf-9547-1e8a59b19f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Volume a1de48ae-bb90-41e2-8e83-1cbc160ec574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574', 'volume_size': 1} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1735909110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1de48ae-bb90-41e2-8e83-1cbc160ec574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe20336c9ec34871b38744555516265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:59Z,use_quota=True,user_id='025fc63e10d5442bafb9937924a85375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Creating volume a1de48ae-bb90-41e2-8e83-1cbc160ec574 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:59 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "cinder-quobyte-522e8a32-f679-4a77-8286-48656f0f85fe" released by "delete_volume" :: held 3.781s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:21:59 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 1073741824 Nov 05 08:21:59 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:59 devstack cinder-volume[87101]: WARNING cinder.quota [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:21:59 devstack cinder-volume[87101]: WARNING cinder.quota [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Created reservations ['78760b91-a8e2-4d14-839d-70f6a4567062', '22937cc4-ce4d-4d53-8eab-7be938fd0dbb', '83512290-6179-4011-8a75-d64c3aced4b6', '84de46e5-0a21-4e43-8bbc-6f19b268797c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:59 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:21:59 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:59 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 1073741824" returned: 0 in 0.762s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:59 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.554s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:59 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:21:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Deleted volume successfully. Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:00 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 Nov 05 08:22:00 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca328951-6f21-492a-b6e4-5f19ffaf62b2 tempest-VolumesAdminNegativeTest-1137449810 None] Lock "cinder-522e8a32-f679-4a77-8286-48656f0f85fe-delete_volume" released by "delete_volume" :: held 5.119s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:00 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574" returned: 0 in 0.696s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6169d5-fe57-4fdf-9547-1e8a59b19f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256ab43-7a70-4aa8-829e-976ce570fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Volume volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 (a1de48ae-bb90-41e2-8e83-1cbc160ec574): created successfully Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256ab43-7a70-4aa8-829e-976ce570fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Flow 'volume_create_manager' (fa1a9de1-80f9-4d04-b64d-30f8a46842d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-811f51a4-96a7-47db-b30c-bf90fa3d7265 tempest-ServersNegativeTestJSON-63085042 None] Created volume successfully. Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Flow 'volume_create_manager' (9b785748-a57b-4ba9-aef6-9b9b22da8895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d850bc03-b75d-4517-a312-5b245311147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d850bc03-b75d-4517-a312-5b245311147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2051299975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df206f-359a-4d27-a0a5-2173edb59592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe20336c9ec34871b38744555516265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:04Z,use_quota=True,user_id='025fc63e10d5442bafb9937924a85375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e5f90-3b1b-438f-941d-19718bd181b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e5f90-3b1b-438f-941d-19718bd181b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8693897-f958-49ae-8fae-9a987bf86131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8693897-f958-49ae-8fae-9a987bf86131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0df206f-359a-4d27-a0a5-2173edb59592', 'volume_name': 'volume-e0df206f-359a-4d27-a0a5-2173edb59592', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85217b-a715-4fae-b77a-420cec53cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85217b-a715-4fae-b77a-420cec53cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e27e21a-c8ad-4f5d-b797-2012d2dfc751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:04 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Volume e0df206f-359a-4d27-a0a5-2173edb59592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0df206f-359a-4d27-a0a5-2173edb59592', 'volume_size': 1} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2051299975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df206f-359a-4d27-a0a5-2173edb59592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe20336c9ec34871b38744555516265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:04Z,use_quota=True,user_id='025fc63e10d5442bafb9937924a85375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Creating volume e0df206f-359a-4d27-a0a5-2173edb59592 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:04 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:04 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 1073741824 Nov 05 08:22:04 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:04 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 1073741824" returned: 0 in 0.546s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:04 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 Nov 05 08:22:04 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:05 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e27e21a-c8ad-4f5d-b797-2012d2dfc751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0df206f-359a-4d27-a0a5-2173edb59592', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817f3d1-81b3-4af1-bc90-53253b68722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Volume volume-e0df206f-359a-4d27-a0a5-2173edb59592 (e0df206f-359a-4d27-a0a5-2173edb59592): created successfully Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817f3d1-81b3-4af1-bc90-53253b68722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Flow 'volume_create_manager' (9b785748-a57b-4ba9-aef6-9b9b22da8895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e6a44173-4a3e-479b-969e-ad0401352614 tempest-ServersNegativeTestJSON-63085042 None] Created volume successfully. Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "cinder-e0df206f-359a-4d27-a0a5-2173edb59592-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-e0df206f-359a-4d27-a0a5-2173edb59592-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "cinder-quobyte-e0df206f-359a-4d27-a0a5-2173edb59592" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-quobyte-e0df206f-359a-4d27-a0a5-2173edb59592" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[36457b34-9408-46a8-8136-2c3dadd9a19b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:07 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 Nov 05 08:22:07 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:08 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592" returned: 0 in 0.456s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:08 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592 Nov 05 08:22:08 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:08 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e0df206f-359a-4d27-a0a5-2173edb59592" returned: 0 in 0.285s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-quobyte-e0df206f-359a-4d27-a0a5-2173edb59592" released by "delete_volume" :: held 0.802s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Created reservations ['6879c7cd-7daf-4ffc-9741-7017ea7e13ce', 'f5d34fad-1034-46d7-b13d-283d7b6c0011', '0448be46-f8ca-429f-8cef-cd48873bb170', 'c478f70a-d5dc-4fbb-acf7-4ca02313e4cb'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:08 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:22:08 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "cinder-a1de48ae-bb90-41e2-8e83-1cbc160ec574-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-a1de48ae-bb90-41e2-8e83-1cbc160ec574-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "cinder-quobyte-a1de48ae-bb90-41e2-8e83-1cbc160ec574" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-quobyte-a1de48ae-bb90-41e2-8e83-1cbc160ec574" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:08 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e0a95c-089d-44df-a5ef-d46edcefca55]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.376s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Deleted volume successfully. Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a6c2910-77cf-42cf-8a05-a5321cafd5f5 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-e0df206f-359a-4d27-a0a5-2173edb59592-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:09 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 Nov 05 08:22:09 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:09 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574" returned: 0 in 0.445s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:09 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574 Nov 05 08:22:09 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:09 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a1de48ae-bb90-41e2-8e83-1cbc160ec574" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-quobyte-a1de48ae-bb90-41e2-8e83-1cbc160ec574" released by "delete_volume" :: held 0.750s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Created reservations ['5980b286-53eb-4bd3-8ddf-2e7195792000', '2c3eff3b-3dfc-4fd1-9a5a-0cf9067a9236', 'b32d2fff-e46d-4478-9079-7e67e68aa6de', '3babda44-1d41-4512-8867-0c3ea25cee8f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:09 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:22:09 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:10 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.316s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:10 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Deleted volume successfully. Nov 05 08:22:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-792863a0-95dc-4258-b526-4f00e6a21bd2 tempest-ServersNegativeTestJSON-63085042 None] Lock "cinder-a1de48ae-bb90-41e2-8e83-1cbc160ec574-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Flow 'volume_create_manager' (2ffb4c6b-0783-4ff8-878a-718a23866adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c0274c-10a9-4b63-948a-194b14808604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c0274c-10a9-4b63-948a-194b14808604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1081949029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cdbe93-3125-4242-8425-09aeef031bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9770581d5141436192031c490e310658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:25Z,use_quota=True,user_id='db09a875af254e979db000e44798c15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f709285-19cf-48de-b53e-abbc97f2fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f709285-19cf-48de-b53e-abbc97f2fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5939d2c-07e3-4021-8655-d98405fb69dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5939d2c-07e3-4021-8655-d98405fb69dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cdbe93-3125-4242-8425-09aeef031bd0', 'volume_name': 'volume-62cdbe93-3125-4242-8425-09aeef031bd0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68de01f3-e2a1-47e4-9274-3a30e0d30109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68de01f3-e2a1-47e4-9274-3a30e0d30109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921ffb1d-e2f7-4592-9f48-f670e72feccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Volume 62cdbe93-3125-4242-8425-09aeef031bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cdbe93-3125-4242-8425-09aeef031bd0', 'volume_size': 1} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1081949029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cdbe93-3125-4242-8425-09aeef031bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9770581d5141436192031c490e310658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:25Z,use_quota=True,user_id='db09a875af254e979db000e44798c15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Creating volume 62cdbe93-3125-4242-8425-09aeef031bd0 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:25 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:22:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:25 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 1073741824 Nov 05 08:22:25 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:26 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 1073741824" returned: 0 in 0.926s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:26 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 Nov 05 08:22:26 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:27 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921ffb1d-e2f7-4592-9f48-f670e72feccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cdbe93-3125-4242-8425-09aeef031bd0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97289ca-753d-4c59-8e09-b450c926398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Volume volume-62cdbe93-3125-4242-8425-09aeef031bd0 (62cdbe93-3125-4242-8425-09aeef031bd0): created successfully Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97289ca-753d-4c59-8e09-b450c926398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Flow 'volume_create_manager' (2ffb4c6b-0783-4ff8-878a-718a23866adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-28695b18-8bbb-47f9-82c2-932486bb1274 tempest-DeleteServersTestJSON-297390316 None] Created volume successfully. Nov 05 08:22:31 devstack cinder-volume[87101]: WARNING py.warnings [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 05 08:22:31 devstack cinder-volume[87101]: .first() Nov 05 08:22:31 devstack cinder-volume[87101]: Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-17f71aff-60f4-4faf-bfc5-db2b7b739c94 req-6ad61452-d04c-4344-9490-0b80cb46bce8 tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-17f71aff-60f4-4faf-bfc5-db2b7b739c94 req-6ad61452-d04c-4344-9490-0b80cb46bce8 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-17f71aff-60f4-4faf-bfc5-db2b7b739c94 req-6ad61452-d04c-4344-9490-0b80cb46bce8 tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-62cdbe93-3125-4242-8425-09aeef031bd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17aed2ce-4f39-40df-a989-1da58239cfc5', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:22:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-17f71aff-60f4-4faf-bfc5-db2b7b739c94 req-6ad61452-d04c-4344-9490-0b80cb46bce8 tempest-TaggedAttachmentsTest-597113232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5e2437b-ba15-4ae7-82d7-de226e5f7b00', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:22:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-4a3d5755-93ca-4d34-b637-48ca5c57906b req-bf8bdd6c-caeb-4c6f-8326-0f12466c0072 tempest-DeleteServersTestJSON-297390316 None] attachment_update completed successfully. Nov 05 08:22:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-17f71aff-60f4-4faf-bfc5-db2b7b739c94 req-6ad61452-d04c-4344-9490-0b80cb46bce8 tempest-TaggedAttachmentsTest-597113232 None] attachment_update completed successfully. Nov 05 08:22:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-425c8b3f-8be5-4475-bce9-b72a7ea68604 req-80f80ec6-d634-4fb6-9c34-05a4e5cc38f7 tempest-DeleteServersTestJSON-297390316 None] Terminate volume connection completed successfully. Nov 05 08:22:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-425c8b3f-8be5-4475-bce9-b72a7ea68604 req-80f80ec6-d634-4fb6-9c34-05a4e5cc38f7 tempest-DeleteServersTestJSON-297390316 None] Deleting attachment 17aed2ce-4f39-40df-a989-1da58239cfc5. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:22:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-2546ac14-9e90-4a34-960e-e5a856fa0d3a req-37a0d2d1-f65d-454a-9931-8aeda4ccb182 tempest-TaggedAttachmentsTest-597113232 None] Terminate volume connection completed successfully. Nov 05 08:22:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-2546ac14-9e90-4a34-960e-e5a856fa0d3a req-37a0d2d1-f65d-454a-9931-8aeda4ccb182 tempest-TaggedAttachmentsTest-597113232 None] Deleting attachment e5e2437b-ba15-4ae7-82d7-de226e5f7b00. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "cinder-62cdbe93-3125-4242-8425-09aeef031bd0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "cinder-62cdbe93-3125-4242-8425-09aeef031bd0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "cinder-quobyte-62cdbe93-3125-4242-8425-09aeef031bd0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "cinder-quobyte-62cdbe93-3125-4242-8425-09aeef031bd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[388fd129-417d-4a1b-beba-c8983946be03]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:40 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 Nov 05 08:22:40 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:41 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:41 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0 Nov 05 08:22:41 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:41 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-62cdbe93-3125-4242-8425-09aeef031bd0" returned: 0 in 0.293s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "cinder-quobyte-62cdbe93-3125-4242-8425-09aeef031bd0" released by "delete_volume" :: held 0.774s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Created reservations ['63dc9f4c-23e9-4b0a-8529-f2db700ae65e', '47100157-c96d-4d75-90e5-9073cec614bb', '0e823a37-e512-494b-b3a3-f35047fe8ef7', 'c361e506-9c97-4afa-b647-013df0965f30'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:41 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:22:41 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:41 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.326s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Deleted volume successfully. Nov 05 08:22:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-172646fd-8a9b-44c1-bc83-593753823c10 tempest-DeleteServersTestJSON-297390316 None] Lock "cinder-62cdbe93-3125-4242-8425-09aeef031bd0-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:48 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:22:48 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:48 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.305s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 8 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:22:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:22:51 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=46,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:22:51 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=47,cinder:UPDATE=49,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "cinder-9ccf8252-df98-4dc9-9086-6b8c730d59bd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "cinder-9ccf8252-df98-4dc9-9086-6b8c730d59bd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "cinder-quobyte-9ccf8252-df98-4dc9-9086-6b8c730d59bd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "cinder-quobyte-9ccf8252-df98-4dc9-9086-6b8c730d59bd" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[96241aa1-e5f5-4f57-acdc-31fcebecc3f3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:02 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd Nov 05 08:23:02 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:03 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd" returned: 0 in 0.909s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:03 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd Nov 05 08:23:03 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:04 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ccf8252-df98-4dc9-9086-6b8c730d59bd" returned: 0 in 0.814s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "cinder-quobyte-9ccf8252-df98-4dc9-9086-6b8c730d59bd" released by "delete_volume" :: held 1.835s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Created reservations ['abef2920-f1a2-4f2b-8033-e8cc3ebf6598', '377c9475-505e-4c18-85ed-2f63e99f1a11', '5cee225d-a581-4d08-8e3e-169ebdf25b6d', 'b2ac0cd9-1d35-4db8-a08c-fd99304803bd'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:04 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:23:04 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:05 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.588s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:05 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Deleted volume successfully. Nov 05 08:23:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f82d9661-dccd-4a1c-b0c4-dc64326b546f tempest-TaggedAttachmentsTest-597113232 None] Lock "cinder-9ccf8252-df98-4dc9-9086-6b8c730d59bd-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:14 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:23:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Flow 'volume_create_manager' (c603454b-42ee-4a35-9935-2532d36183ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014fe706-d6e3-43f4-8ea8-a591c0495e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014fe706-d6e3-43f4-8ea8-a591c0495e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1123780492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30503b8-6825-44af-8935-159ed08576d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e7051c6e774d668914fca2dba455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:32Z,use_quota=True,user_id='091b379fc4144333a551a2e4dee53a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d24c46-de44-48d5-8e78-2d26ef88c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d24c46-de44-48d5-8e78-2d26ef88c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8781276f-695b-45e8-a9c7-be850d32cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8781276f-695b-45e8-a9c7-be850d32cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30503b8-6825-44af-8935-159ed08576d2', 'volume_name': 'volume-b30503b8-6825-44af-8935-159ed08576d2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c5f019-7bb5-4053-a9eb-86548c1f106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c5f019-7bb5-4053-a9eb-86548c1f106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4af54e-950f-4719-b12a-ff68fd44b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:32 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Volume b30503b8-6825-44af-8935-159ed08576d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30503b8-6825-44af-8935-159ed08576d2', 'volume_size': 1} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1123780492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30503b8-6825-44af-8935-159ed08576d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e7051c6e774d668914fca2dba455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:32Z,use_quota=True,user_id='091b379fc4144333a551a2e4dee53a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Creating volume b30503b8-6825-44af-8935-159ed08576d2 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:32 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:23:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:32 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 1073741824 Nov 05 08:23:32 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 1073741824" returned: 0 in 0.887s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:33 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:33 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 Nov 05 08:23:33 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:34 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2" returned: 0 in 0.596s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4af54e-950f-4719-b12a-ff68fd44b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30503b8-6825-44af-8935-159ed08576d2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b989f8a4-8a32-4b1e-a06c-7393e4c402aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Volume volume-b30503b8-6825-44af-8935-159ed08576d2 (b30503b8-6825-44af-8935-159ed08576d2): created successfully Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b989f8a4-8a32-4b1e-a06c-7393e4c402aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Flow 'volume_create_manager' (c603454b-42ee-4a35-9935-2532d36183ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a71639d7-3bf4-4484-9615-830bf6ce6c3d tempest-ServerRescueNegativeTestJSON-1541338380 None] Created volume successfully. Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Flow 'volume_create_manager' (78e9b7ab-2f7b-4560-bee9-2f2fb9c2709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199ca7f1-b843-468f-8703-1fa8b682ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199ca7f1-b843-468f-8703-1fa8b682ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604811859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8df153e-5e77-472f-8034-75adf474f1dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c937d39d92d44bbfbabb388f3b95d47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:34Z,use_quota=True,user_id='dd3c965b0dcf4a84a65123b7ebfd5c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3c065a-3ccf-4471-bad9-03c95621dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3c065a-3ccf-4471-bad9-03c95621dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36363c1f-2715-48e6-b867-d3159a2aa94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36363c1f-2715-48e6-b867-d3159a2aa94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8df153e-5e77-472f-8034-75adf474f1dc', 'volume_name': 'volume-a8df153e-5e77-472f-8034-75adf474f1dc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9ffb7b-1d1b-4259-a637-da4e6bed7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9ffb7b-1d1b-4259-a637-da4e6bed7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2ab7bb-3989-43bc-bf2b-8b83f9796664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Volume a8df153e-5e77-472f-8034-75adf474f1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8df153e-5e77-472f-8034-75adf474f1dc', 'volume_size': 1} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604811859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8df153e-5e77-472f-8034-75adf474f1dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c937d39d92d44bbfbabb388f3b95d47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:34Z,use_quota=True,user_id='dd3c965b0dcf4a84a65123b7ebfd5c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Creating volume a8df153e-5e77-472f-8034-75adf474f1dc {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:34 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:23:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:34 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc 1073741824 Nov 05 08:23:34 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:35 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc 1073741824" returned: 0 in 0.543s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:35 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc Nov 05 08:23:35 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:35 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc" returned: 0 in 0.465s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2ab7bb-3989-43bc-bf2b-8b83f9796664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8df153e-5e77-472f-8034-75adf474f1dc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b2e43d-7689-42f9-9239-2219e8514b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Volume volume-a8df153e-5e77-472f-8034-75adf474f1dc (a8df153e-5e77-472f-8034-75adf474f1dc): created successfully Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b2e43d-7689-42f9-9239-2219e8514b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Flow 'volume_create_manager' (78e9b7ab-2f7b-4560-bee9-2f2fb9c2709e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-c6ff8e6f-d9c5-45a0-bb49-26f78dddba56 req-567c212e-ad07-4392-87a3-55d9969c95b3 tempest-VolumesGetTestJSON-158327377 None] Created volume successfully. Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Acquiring lock "cinder-a8df153e-5e77-472f-8034-75adf474f1dc-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "cinder-a8df153e-5e77-472f-8034-75adf474f1dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Acquiring lock "cinder-quobyte-a8df153e-5e77-472f-8034-75adf474f1dc" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "cinder-quobyte-a8df153e-5e77-472f-8034-75adf474f1dc" acquired by "delete_volume" :: waited 0.048s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b390e-5c31-4814-a7fc-c312ccde9498]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:37 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc Nov 05 08:23:37 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:38 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc" returned: 0 in 0.851s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:38 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc Nov 05 08:23:38 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:38 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8df153e-5e77-472f-8034-75adf474f1dc" returned: 0 in 0.460s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "cinder-quobyte-a8df153e-5e77-472f-8034-75adf474f1dc" released by "delete_volume" :: held 1.478s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:38 devstack cinder-volume[87101]: DEBUG cinder.quota [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Created reservations ['e9f52df1-9e20-4931-999d-259f7eaec0e8', 'b4837329-386a-4a86-8321-b52532960c27', '9cfbda1e-a02b-40be-b2d5-497bb0502850', 'd9100fbb-b8eb-4412-9b46-9954639d76c0'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:39 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:23:39 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:39 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.366s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG cinder.manager [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Deleted volume successfully. Nov 05 08:23:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-f0b37091-a67e-4805-867e-a3cebcf897d9 req-df57d9c5-737d-49f3-8ff6-541dc3ac8617 tempest-VolumesGetTestJSON-158327377 None] Lock "cinder-a8df153e-5e77-472f-8034-75adf474f1dc-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (d6f409b1-cbe1-4de7-831b-574fe91349fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1ed81-b27d-4c74-95c9-cee9070d1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1ed81-b27d-4c74-95c9-cee9070d1726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1681270295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6a9ae5-38e3-4c2b-b54d-665a7f085339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:41Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d184b998-aecf-4b31-ac1c-7a0f060d8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d184b998-aecf-4b31-ac1c-7a0f060d8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da0e473-2b8d-4da2-9f92-ce5ca8250702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da0e473-2b8d-4da2-9f92-ce5ca8250702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6a9ae5-38e3-4c2b-b54d-665a7f085339', 'volume_name': 'volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c841a7-299e-4432-b91d-f575d695c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c841a7-299e-4432-b91d-f575d695c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30604b8-88e1-4d7f-83df-6c9aaed24494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Volume ee6a9ae5-38e3-4c2b-b54d-665a7f085339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339', 'volume_size': 1} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1681270295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6a9ae5-38e3-4c2b-b54d-665a7f085339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:41Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Creating volume ee6a9ae5-38e3-4c2b-b54d-665a7f085339 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:41 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:23:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:41 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 1073741824 Nov 05 08:23:41 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:42 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 1073741824" returned: 0 in 0.862s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:42 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 Nov 05 08:23:42 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:42 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" returned: 0 in 0.646s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30604b8-88e1-4d7f-83df-6c9aaed24494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f15ebc-3657-4682-8c90-ac2e897ae9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Volume volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 (ee6a9ae5-38e3-4c2b-b54d-665a7f085339): created successfully Nov 05 08:23:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f15ebc-3657-4682-8c90-ac2e897ae9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (d6f409b1-cbe1-4de7-831b-574fe91349fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:43 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8f0d3515-846b-43d6-84a6-c5a57b6585d1 tempest-AttachVolumeTestJSON-1774921419 None] Created volume successfully. Nov 05 08:23:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-5a407418-6487-4876-a44f-75e91f10c16d req-27b31e91-f547-4fe9-a3c9-158947dd4f16 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-5a407418-6487-4876-a44f-75e91f10c16d req-27b31e91-f547-4fe9-a3c9-158947dd4f16 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-5a407418-6487-4876-a44f-75e91f10c16d req-27b31e91-f547-4fe9-a3c9-158947dd4f16 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-5a407418-6487-4876-a44f-75e91f10c16d req-27b31e91-f547-4fe9-a3c9-158947dd4f16 tempest-AttachVolumeTestJSON-1774921419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52fa391d-034d-4ac2-a5f0-c0f3d34e9de9', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:23:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-5a407418-6487-4876-a44f-75e91f10c16d req-27b31e91-f547-4fe9-a3c9-158947dd4f16 tempest-AttachVolumeTestJSON-1774921419 None] attachment_update completed successfully. Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:48 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:23:48 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Acquiring lock "cinder-b30503b8-6825-44af-8935-159ed08576d2-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "cinder-b30503b8-6825-44af-8935-159ed08576d2-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e4b33385-0b4a-4dae-8cad-1e62712c2eb5 tempest-BackendsCapabilitiesAdminTestsJSON-368664646 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87101) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Acquiring lock "cinder-quobyte-b30503b8-6825-44af-8935-159ed08576d2" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "cinder-quobyte-b30503b8-6825-44af-8935-159ed08576d2" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8c37ed9d-f44d-45c2-99ff-24536b9f1eac tempest-BackendsCapabilitiesAdminTestsJSON-368664646 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87101) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[15873467-851e-41ad-800c-d132e8bffa3c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:49 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 Nov 05 08:23:49 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:49 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.864s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 8 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:23:49 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2" returned: 0 in 1.010s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:50 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2 Nov 05 08:23:50 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:50 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b30503b8-6825-44af-8935-159ed08576d2" returned: 0 in 0.600s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "cinder-quobyte-b30503b8-6825-44af-8935-159ed08576d2" released by "delete_volume" :: held 1.728s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Created reservations ['a0b4f7fc-4e61-47f9-b33e-457f18880ba9', 'a9a384fa-cbbd-4ed1-b856-955fa7ac8a30', '8c6945dd-5120-4527-934a-dc4f8babafe4', 'b59bf587-5e51-4eb6-ae0f-1f8700c25db4'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:50 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:23:50 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:51 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:51 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Deleted volume successfully. Nov 05 08:23:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-42db85c7-70cb-4fb0-8fbd-594b8b0df2be tempest-ServerRescueNegativeTestJSON-1541338380 None] Lock "cinder-b30503b8-6825-44af-8935-159ed08576d2-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5264f0f3-c386-4f02-881d-c2537669458a tempest-GroupSnapshotsV319Test-146455923 None] Group tempest-GroupSnapshotsV319Test-Group-761723494: creating Nov 05 08:24:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5264f0f3-c386-4f02-881d-c2537669458a tempest-GroupSnapshotsV319Test-146455923 None] Group tempest-GroupSnapshotsV319Test-Group-761723494: created successfully Nov 05 08:24:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5264f0f3-c386-4f02-881d-c2537669458a tempest-GroupSnapshotsV319Test-146455923 None] Create group completed successfully. Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Flow 'volume_create_manager' (b189ffc4-a889-4adb-9a79-0170cbe2e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef873e-0baa-48ce-96e8-6f0125166d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef873e-0baa-48ce-96e8-6f0125166d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2143046994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7ecd49-f196-442b-841a-64c7f445f1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b9d3661403449bac89b06ab56dbdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:02Z,use_quota=True,user_id='5c588c81ce0842278b00a35e85e46fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1024b0-22db-4f46-bf34-4700accc224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1024b0-22db-4f46-bf34-4700accc224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06950c03-1321-4089-ae9d-d4b64774b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06950c03-1321-4089-ae9d-d4b64774b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7ecd49-f196-442b-841a-64c7f445f1c4', 'volume_name': 'volume-da7ecd49-f196-442b-841a-64c7f445f1c4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da64696-539f-4881-8987-2df412c36e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da64696-539f-4881-8987-2df412c36e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de76bdd7-5851-4595-ab49-435d48de1d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Volume da7ecd49-f196-442b-841a-64c7f445f1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7ecd49-f196-442b-841a-64c7f445f1c4', 'volume_size': 1} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2143046994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7ecd49-f196-442b-841a-64c7f445f1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b9d3661403449bac89b06ab56dbdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:02Z,use_quota=True,user_id='5c588c81ce0842278b00a35e85e46fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Creating volume da7ecd49-f196-442b-841a-64c7f445f1c4 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:01 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:02 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 1073741824 Nov 05 08:24:02 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Flow 'volume_create_manager' (6cc1ed30-93f5-44c4-a4e3-53c751ddbf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fb3ffb-5ecb-45fc-a944-daea77f0edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fb3ffb-5ecb-45fc-a944-daea77f0edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375300314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97d9c53e-5654-4d3b-8429-8f39f5e42c3a,host='devstack@QuobyteHD#QuobyteHD',id=6d1b34c5-b1c2-4f63-98f0-907f6837647c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f018ec3476c48e2800aa9eb561fbcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:03Z,use_quota=True,user_id='9d04740f5a5843128b9bdb9fc8b1e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcc94a0-1687-4e96-932c-e18f912019db),volume_type_id=cfcc94a0-1687-4e96-932c-e18f912019db)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:02 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daebc02-4990-4dc2-8bae-c57b4478dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daebc02-4990-4dc2-8bae-c57b4478dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac879385-c368-418b-9354-cd6a7bfc5110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac879385-c368-418b-9354-cd6a7bfc5110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1b34c5-b1c2-4f63-98f0-907f6837647c', 'volume_name': 'volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc2524-4993-478a-a64e-e1d49dc90ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc2524-4993-478a-a64e-e1d49dc90ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94ee7eb-eaf1-4cf7-9601-499699eb2218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:02 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Volume 6d1b34c5-b1c2-4f63-98f0-907f6837647c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c', 'volume_size': 1} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 1073741824" returned: 0 in 0.905s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:02 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 Nov 05 08:24:02 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:03 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4" returned: 0 in 0.264s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97d9c53e-5654-4d3b-8429-8f39f5e42c3a,created_at=2026-11-05T07:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375300314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97d9c53e-5654-4d3b-8429-8f39f5e42c3a,host='devstack@QuobyteHD#QuobyteHD',id=6d1b34c5-b1c2-4f63-98f0-907f6837647c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f018ec3476c48e2800aa9eb561fbcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:03Z,use_quota=True,user_id='9d04740f5a5843128b9bdb9fc8b1e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcc94a0-1687-4e96-932c-e18f912019db),volume_type_id=cfcc94a0-1687-4e96-932c-e18f912019db)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Creating volume 6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:03 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de76bdd7-5851-4595-ab49-435d48de1d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7ecd49-f196-442b-841a-64c7f445f1c4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24f7bee-ff13-4eea-8c92-776d69ef089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:03 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c 1073741824 Nov 05 08:24:03 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:03 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Volume volume-da7ecd49-f196-442b-841a-64c7f445f1c4 (da7ecd49-f196-442b-841a-64c7f445f1c4): created successfully Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24f7bee-ff13-4eea-8c92-776d69ef089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Flow 'volume_create_manager' (b189ffc4-a889-4adb-9a79-0170cbe2e70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ab288d38-eae6-462a-9834-c118fda48d04 tempest-ServerActionsTestOtherA-1119472718 None] Created volume successfully. Nov 05 08:24:04 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c 1073741824" returned: 0 in 0.835s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:04 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c Nov 05 08:24:04 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:04 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c" returned: 0 in 0.376s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94ee7eb-eaf1-4cf7-9601-499699eb2218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f091963f-f7f8-454c-b062-45d7c669671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:04 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Volume volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c (6d1b34c5-b1c2-4f63-98f0-907f6837647c): created successfully Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f091963f-f7f8-454c-b062-45d7c669671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Flow 'volume_create_manager' (6cc1ed30-93f5-44c4-a4e3-53c751ddbf05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-86b69660-154f-43ed-9470-7a021af5a70c tempest-GroupSnapshotsV319Test-146455923 None] Created volume successfully. Nov 05 08:24:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] GroupSnapshot 2726fd48-e753-4847-a522-dc73eaa03b71: creating. Nov 05 08:24:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Group snapshot 2726fd48-e753-4847-a522-dc73eaa03b71: creating. {{(pid=87101) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:24:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Creating offline snapshot d3df071a-faa5-4af0-abf5-06a0030df926 of volume 6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:24:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fd5a06-4312-470e-bbda-24aeb1c84cd8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:06 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c Nov 05 08:24:06 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:06 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c" returned: 0 in 0.595s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:06 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 1G Nov 05 08:24:06 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:07 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 1G" returned: 0 in 0.608s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:07 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 Nov 05 08:24:07 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:07 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926" returned: 0 in 0.450s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:07 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:07 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 Nov 05 08:24:07 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:08 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:08 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info Nov 05 08:24:08 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:08 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:08 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:08 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info Nov 05 08:24:08 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:08 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.info" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b4f4c859-ae8f-424e-a308-89bd6fbd8705 tempest-GroupSnapshotsV319Test-146455923 None] group_snapshot 2726fd48-e753-4847-a522-dc73eaa03b71: created successfully Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Flow 'volume_create_manager' (22c234f6-0b08-4bad-ae88-4ee3f2a6c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2897cc8-b8c6-454f-96c7-41ea6664beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2897cc8-b8c6-454f-96c7-41ea6664beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-514036096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16301487-0792-4468-bbe1-628dd880d2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a764c9f002c449ad9bbceb4f61762dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:10Z,use_quota=True,user_id='c391788266e34ff5974feb2f54cd495c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cbb154-779d-4388-a70b-c744960c25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cbb154-779d-4388-a70b-c744960c25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e6176d-4e02-42ef-acad-7a0d63958df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e6176d-4e02-42ef-acad-7a0d63958df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16301487-0792-4468-bbe1-628dd880d2b3', 'volume_name': 'volume-16301487-0792-4468-bbe1-628dd880d2b3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aeee885-e862-4e50-8b39-c0b74f9248e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aeee885-e862-4e50-8b39-c0b74f9248e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03141f99-bde9-4d5c-bebc-af7510c1e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Volume 16301487-0792-4468-bbe1-628dd880d2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16301487-0792-4468-bbe1-628dd880d2b3', 'volume_size': 1} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-514036096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16301487-0792-4468-bbe1-628dd880d2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a764c9f002c449ad9bbceb4f61762dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:10Z,use_quota=True,user_id='c391788266e34ff5974feb2f54cd495c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Creating volume 16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:09 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:09 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 1073741824 Nov 05 08:24:09 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] group_snapshot 2726fd48-e753-4847-a522-dc73eaa03b71: deleting Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] group_snapshot 2726fd48-e753-4847-a522-dc73eaa03b71: deleting {{(pid=87101) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "cinder-quobyte-d3df071a-faa5-4af0-abf5-06a0030df926" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-d3df071a-faa5-4af0-abf5-06a0030df926" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Deleting offline snapshot d3df071a-faa5-4af0-abf5-06a0030df926 of volume 6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] snapshot_file for this snap is: volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2291ec-2dd7-4926-a1a3-ccf0fdc18e18]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:10 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 1073741824" returned: 0 in 0.673s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:10 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 Nov 05 08:24:10 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:10 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 Nov 05 08:24:10 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:10 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8571c30-39ea-44e7-9940-dc23b6dc1eef]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:10 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3" returned: 0 in 0.328s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03141f99-bde9-4d5c-bebc-af7510c1e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16301487-0792-4468-bbe1-628dd880d2b3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551b15a-95f8-49ec-a0f9-85d5e7749a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Volume volume-16301487-0792-4468-bbe1-628dd880d2b3 (16301487-0792-4468-bbe1-628dd880d2b3): created successfully Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551b15a-95f8-49ec-a0f9-85d5e7749a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Flow 'volume_create_manager' (22c234f6-0b08-4bad-ae88-4ee3f2a6c897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-0a627b0c-7947-4fa6-b632-7da0c4a460b3 req-22130cc3-60e7-46a5-b777-370535ac6a26 tempest-VolumesSnapshotsTestJSON-1805764182 None] Created volume successfully. Nov 05 08:24:11 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c Nov 05 08:24:11 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:11 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c" returned: 0 in 0.427s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:11 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 Nov 05 08:24:11 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:11 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926" returned: 0 in 0.562s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:11 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926 Nov 05 08:24:11 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:12 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c.d3df071a-faa5-4af0-abf5-06a0030df926" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-d3df071a-faa5-4af0-abf5-06a0030df926" released by "_delete_snapshot" :: held 2.000s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" released by "delete_snapshot" :: held 2.043s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Creating offline snapshot 26251bbb-76df-47ba-8fc6-d974e8ddb1f6 of volume 16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3b019-91ba-4233-9863-490974c5b3a0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:12 devstack cinder-volume[87101]: WARNING cinder.quota [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-244379724 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-244379724, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:12 devstack cinder-volume[87101]: WARNING cinder.quota [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-244379724 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-244379724, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:12 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] Created reservations ['bc7a9d9b-950e-492c-ae64-f7a0de15f139', '91c131d6-1b9b-4008-bc91-ce7ff78ae507', 'e84c0164-102f-49d8-b110-8d22d2c7e05e', 'ad706dcd-9e9a-4776-83d5-d370c672f006'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:12 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 Nov 05 08:24:12 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e7d2bcad-7a8f-4177-a493-09015a7f2e85 tempest-GroupSnapshotsV319Test-146455923 None] group_snapshot 2726fd48-e753-4847-a522-dc73eaa03b71: deleted successfully Nov 05 08:24:13 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3" returned: 0 in 0.532s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 1G Nov 05 08:24:13 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d0159c-5baa-463a-a239-0248b44bf1b5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c Nov 05 08:24:13 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:13 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 1G" returned: 0 in 0.608s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16301487-0792-4468-bbe1-628dd880d2b3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16301487-0792-4468-bbe1-628dd880d2b3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 Nov 05 08:24:13 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:13 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c" returned: 0 in 0.530s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c Nov 05 08:24:13 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:13 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16301487-0792-4468-bbe1-628dd880d2b3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:13 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 is being set with open permissions: ugo+rw Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d1b34c5-b1c2-4f63-98f0-907f6837647c" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:14 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 Nov 05 08:24:14 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Lock "cinder-quobyte-6d1b34c5-b1c2-4f63-98f0-907f6837647c" released by "delete_volume" :: held 0.947s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Created reservations ['9fa30f82-8fc0-4f4b-a5ea-0136269fc355'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:14 devstack cinder-volume[87101]: WARNING cinder.quota [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-244379724 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-244379724, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Created reservations ['0f5f0d06-139e-4099-ba5f-00902d5260a6', '420e87c5-cce3-4dad-87f8-5ef6a2eae23a', '1bbf06e8-9c59-4a8a-a18f-86c79903c221', '0b2edc21-ac83-4069-905c-f9c016cffae9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:14 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6" returned: 0 in 0.326s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:14 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:14 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:14 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info Nov 05 08:24:14 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:14 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info" returned: 0 in 0.340s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:14 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info is being set with open permissions: ugo+rw Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:14 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:14 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ac877cba-3d5d-4ce3-8ea1-1ed55d07b0e6 tempest-GroupSnapshotsV319Test-146455923 None] Delete group completed successfully. Nov 05 08:24:14 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info Nov 05 08:24:14 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:15 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.info" returned: 0 in 0.537s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-4f490f15-4bbf-4437-8282-d4147a900d13 req-a9f26e87-e972-4e4a-b4f0-c3afd650f3ae tempest-VolumesSnapshotsTestJSON-1805764182 None] Create snapshot completed successfully Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "cinder-26251bbb-76df-47ba-8fc6-d974e8ddb1f6-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-26251bbb-76df-47ba-8fc6-d974e8ddb1f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "cinder-quobyte-26251bbb-76df-47ba-8fc6-d974e8ddb1f6" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-26251bbb-76df-47ba-8fc6-d974e8ddb1f6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Deleting offline snapshot 26251bbb-76df-47ba-8fc6-d974e8ddb1f6 of volume 16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] snapshot_file for this snap is: volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d7d659-a151-44b0-88ed-a41a3d8afc60]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:16 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 Nov 05 08:24:16 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:16 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6" returned: 0 in 0.566s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16301487-0792-4468-bbe1-628dd880d2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb82bc9-eea6-4013-be57-f114ee660aee]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:16 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 Nov 05 08:24:16 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:17 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3" returned: 0 in 0.438s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:17 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 Nov 05 08:24:17 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:17 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:17 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6 Nov 05 08:24:17 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:18 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3.26251bbb-76df-47ba-8fc6-d974e8ddb1f6" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-26251bbb-76df-47ba-8fc6-d974e8ddb1f6" released by "_delete_snapshot" :: held 2.023s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" released by "delete_snapshot" :: held 2.066s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:18 devstack cinder-volume[87101]: WARNING cinder.quota [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:18 devstack cinder-volume[87101]: DEBUG cinder.quota [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Created reservations ['e582fff0-f1df-4dbb-9b5f-881262ba8396', '62cefd44-554f-4803-8eba-d46554d0f525', 'd5ff8f67-c286-4eb4-bd15-a5776b0eb933', '26e71cd0-8f63-4837-aacc-e925aa146e24'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Delete snapshot completed successfully. Nov 05 08:24:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-9b4d2ea6-4ab0-428e-a061-babdbc2f4e14 req-37f8f120-949f-4877-ab47-99212220aa4b tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-26251bbb-76df-47ba-8fc6-d974e8ddb1f6-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "cinder-16301487-0792-4468-bbe1-628dd880d2b3-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-16301487-0792-4468-bbe1-628dd880d2b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[16baf49d-4324-454e-bc66-5a8631171312]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:19 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 Nov 05 08:24:19 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:20 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:20 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3 Nov 05 08:24:20 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:20 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-16301487-0792-4468-bbe1-628dd880d2b3" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-quobyte-16301487-0792-4468-bbe1-628dd880d2b3" released by "delete_volume" :: held 0.782s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.quota [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Created reservations ['1e5b3f1e-9f54-4375-bc82-6b1d453e6588', '34f10751-fbfe-4db5-a488-176bff4323a7', 'a2ba5499-7b66-4f6d-859b-af6bf31e4e24', '1b3f9182-fad8-4d3b-bf04-b8dd523f9021'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:20 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:20 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:20 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.303s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.manager [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Deleted volume successfully. Nov 05 08:24:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-a110c5cc-321f-4b36-9023-1f324b7f9eb7 req-3086256e-8388-4b1e-b97e-3c7428ab0559 tempest-VolumesSnapshotsTestJSON-1805764182 None] Lock "cinder-16301487-0792-4468-bbe1-628dd880d2b3-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-04243cb8-00f7-4a8c-a17f-d55e05f3726a req-3767ede1-fb1c-4bac-8a06-e6646a08715c tempest-AttachVolumeTestJSON-1774921419 None] Terminate volume connection completed successfully. Nov 05 08:24:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-04243cb8-00f7-4a8c-a17f-d55e05f3726a req-3767ede1-fb1c-4bac-8a06-e6646a08715c tempest-AttachVolumeTestJSON-1774921419 None] Deleting attachment 52fa391d-034d-4ac2-a5f0-c0f3d34e9de9. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=70,cinder:INSERT=17,cinder:DELETE=6,cinder:SELECT=63 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=71,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (71d4c879-74ce-47ba-acc1-8c793d674cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec11c0-af44-4e41-83ce-b9742e528f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec11c0-af44-4e41-83ce-b9742e528f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111130033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17196645-db45-495e-84b9-7fbf2f9fb2b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:27Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8682ee11-7852-40e5-833e-660b58c3914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8682ee11-7852-40e5-833e-660b58c3914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d207313-c787-4fc0-b9b8-5088dc6c8392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d207313-c787-4fc0-b9b8-5088dc6c8392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17196645-db45-495e-84b9-7fbf2f9fb2b6', 'volume_name': 'volume-17196645-db45-495e-84b9-7fbf2f9fb2b6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a96ca5-632e-4059-a94b-2030f181f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a96ca5-632e-4059-a94b-2030f181f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7ba25c-154f-48f5-b891-0a54baffe19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Volume 17196645-db45-495e-84b9-7fbf2f9fb2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17196645-db45-495e-84b9-7fbf2f9fb2b6', 'volume_size': 1} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111130033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17196645-db45-495e-84b9-7fbf2f9fb2b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:27Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Creating volume 17196645-db45-495e-84b9-7fbf2f9fb2b6 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:27 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:27 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 1073741824 Nov 05 08:24:27 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 1073741824" returned: 0 in 0.806s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 Nov 05 08:24:28 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6" returned: 0 in 0.320s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7ba25c-154f-48f5-b891-0a54baffe19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17196645-db45-495e-84b9-7fbf2f9fb2b6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e26a8a-b413-40a0-bbcc-ea925e5a3141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:29 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Volume volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 (17196645-db45-495e-84b9-7fbf2f9fb2b6): created successfully Nov 05 08:24:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e26a8a-b413-40a0-bbcc-ea925e5a3141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (71d4c879-74ce-47ba-acc1-8c793d674cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e9278fe5-7679-4573-870c-223e9e831659 tempest-VolumesTestJSON-760145110 None] Created volume successfully. Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (2adcc4d8-ff6f-4da6-9e63-fb9e22247b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeb2fd9-7c5b-4980-841c-23804a6226d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeb2fd9-7c5b-4980-841c-23804a6226d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1394883853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e8baee-6644-4c69-be62-106a36f59ad8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:30Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63374e3c-b1af-4bf6-8d4b-8b045422f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63374e3c-b1af-4bf6-8d4b-8b045422f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf08a82-f484-438a-9a6d-5cc78473af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf08a82-f484-438a-9a6d-5cc78473af39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e8baee-6644-4c69-be62-106a36f59ad8', 'volume_name': 'volume-d1e8baee-6644-4c69-be62-106a36f59ad8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef45b50-2dad-45f3-a340-b71064a2c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef45b50-2dad-45f3-a340-b71064a2c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499ca9a8-8e5a-4590-b5e5-63e49ec91ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:30 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Volume d1e8baee-6644-4c69-be62-106a36f59ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e8baee-6644-4c69-be62-106a36f59ad8', 'volume_size': 1} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1394883853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e8baee-6644-4c69-be62-106a36f59ad8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:30Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Creating volume d1e8baee-6644-4c69-be62-106a36f59ad8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:30 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:30 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 1073741824 Nov 05 08:24:30 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:30 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 1073741824" returned: 0 in 0.486s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:30 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 Nov 05 08:24:30 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:31 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499ca9a8-8e5a-4590-b5e5-63e49ec91ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e8baee-6644-4c69-be62-106a36f59ad8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42110fb5-d26e-410e-9f10-d6872f92c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Volume volume-d1e8baee-6644-4c69-be62-106a36f59ad8 (d1e8baee-6644-4c69-be62-106a36f59ad8): created successfully Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42110fb5-d26e-410e-9f10-d6872f92c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (2adcc4d8-ff6f-4da6-9e63-fb9e22247b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c8780b2a-dcb2-4ba3-8860-4869fc02052c tempest-VolumesTestJSON-760145110 None] Created volume successfully. Nov 05 08:24:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d6e196b4-8498-4279-920d-f440437a0f1b tempest-GroupsTest-994133300 None] Group tempest-Group1-161449129: creating Nov 05 08:24:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d6e196b4-8498-4279-920d-f440437a0f1b tempest-GroupsTest-994133300 None] Group tempest-Group1-161449129: created successfully Nov 05 08:24:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d6e196b4-8498-4279-920d-f440437a0f1b tempest-GroupsTest-994133300 None] Create group completed successfully. Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-31e150f6-9580-41c3-971e-0ff2071173e0 tempest-GroupsTest-994133300 None] Group tempest-Group2-1070945285: creating Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (9c573a1b-5daa-48e3-8f71-73597f813924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa6c06-f9e2-4171-b84a-82e4b4943bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa6c06-f9e2-4171-b84a-82e4b4943bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875974369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b98a8aa-2ec8-474e-8010-7451f045c3c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:33Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141ed987-c2f6-414f-bc8e-31e883494218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141ed987-c2f6-414f-bc8e-31e883494218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e20153-5cd5-4ab4-a0bd-54a38ba1297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e20153-5cd5-4ab4-a0bd-54a38ba1297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b98a8aa-2ec8-474e-8010-7451f045c3c1', 'volume_name': 'volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32109cba-66ad-4454-8a83-e5e302acbc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32109cba-66ad-4454-8a83-e5e302acbc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f105795-d59b-4463-ae12-c56dc317e087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Volume 9b98a8aa-2ec8-474e-8010-7451f045c3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1', 'volume_size': 1} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875974369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b98a8aa-2ec8-474e-8010-7451f045c3c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4529b1f24b254eaca9e7c1b883d0684f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:33Z,use_quota=True,user_id='20775f8d4dda47b19d9ed61757d436c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Creating volume 9b98a8aa-2ec8-474e-8010-7451f045c3c1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:33 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 1073741824 Nov 05 08:24:33 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-31e150f6-9580-41c3-971e-0ff2071173e0 tempest-GroupsTest-994133300 None] Group tempest-Group2-1070945285: created successfully Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-31e150f6-9580-41c3-971e-0ff2071173e0 tempest-GroupsTest-994133300 None] Create group completed successfully. Nov 05 08:24:33 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 1073741824" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:33 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 Nov 05 08:24:33 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:33 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f105795-d59b-4463-ae12-c56dc317e087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e83e97-8e84-4868-898a-7abee29ab931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Volume volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 (9b98a8aa-2ec8-474e-8010-7451f045c3c1): created successfully Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e83e97-8e84-4868-898a-7abee29ab931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Flow 'volume_create_manager' (9c573a1b-5daa-48e3-8f71-73597f813924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5b95d056-e066-4c56-baa5-014e6706daa1 tempest-VolumesTestJSON-760145110 None] Created volume successfully. Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (4d10a8e7-d922-4aae-83eb-232e015085b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc69699-848e-4387-940e-1cfd42713dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc69699-848e-4387-940e-1cfd42713dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110209433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4294903-e7c4-49bc-bd19-8f146985dfbc,host='devstack@QuobyteHD#QuobyteHD',id=b08b3130-69df-4b7e-954b-984b2decd9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:35Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6735a95e-bfa2-4b7c-bc09-7bf7afcee211),volume_type_id=6735a95e-bfa2-4b7c-bc09-7bf7afcee211)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ce072-3af9-4b47-a413-cf812f1f1f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ce072-3af9-4b47-a413-cf812f1f1f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef792b5-c4a7-4bf3-ad0a-d6bf636de250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef792b5-c4a7-4bf3-ad0a-d6bf636de250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08b3130-69df-4b7e-954b-984b2decd9de', 'volume_name': 'volume-b08b3130-69df-4b7e-954b-984b2decd9de', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78db809b-4229-4086-9ca3-c85b15f0700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78db809b-4229-4086-9ca3-c85b15f0700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf3a4d6-1560-4c2c-9e79-403a6014f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Volume b08b3130-69df-4b7e-954b-984b2decd9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08b3130-69df-4b7e-954b-984b2decd9de', 'volume_size': 1} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4294903-e7c4-49bc-bd19-8f146985dfbc,created_at=2026-11-05T07:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110209433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4294903-e7c4-49bc-bd19-8f146985dfbc,host='devstack@QuobyteHD#QuobyteHD',id=b08b3130-69df-4b7e-954b-984b2decd9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:35Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6735a95e-bfa2-4b7c-bc09-7bf7afcee211),volume_type_id=6735a95e-bfa2-4b7c-bc09-7bf7afcee211)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Creating volume b08b3130-69df-4b7e-954b-984b2decd9de {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:34 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:34 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de 1073741824 Nov 05 08:24:34 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:35 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de 1073741824" returned: 0 in 0.466s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:35 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de Nov 05 08:24:35 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:35 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de" returned: 0 in 0.286s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf3a4d6-1560-4c2c-9e79-403a6014f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08b3130-69df-4b7e-954b-984b2decd9de', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec7d299-be9a-45da-a115-035d58f95f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Volume volume-b08b3130-69df-4b7e-954b-984b2decd9de (b08b3130-69df-4b7e-954b-984b2decd9de): created successfully Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec7d299-be9a-45da-a115-035d58f95f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (4d10a8e7-d922-4aae-83eb-232e015085b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9e9b00cd-27cc-429b-ae8c-8427d4163359 tempest-GroupsTest-994133300 None] Created volume successfully. Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-9b98a8aa-2ec8-474e-8010-7451f045c3c1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "cinder-9b98a8aa-2ec8-474e-8010-7451f045c3c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-quobyte-9b98a8aa-2ec8-474e-8010-7451f045c3c1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-9b98a8aa-2ec8-474e-8010-7451f045c3c1" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a1808-9316-4c1a-a8ca-c4b7951e2ec5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:36 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 Nov 05 08:24:36 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Acquiring lock "cinder-quobyte-b08b3130-69df-4b7e-954b-984b2decd9de" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-b08b3130-69df-4b7e-954b-984b2decd9de" acquired by "delete_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ce2f2-1755-45d9-879b-7e314361dea5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:36 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1" returned: 0 in 0.596s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1 Nov 05 08:24:37 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de Nov 05 08:24:37 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b98a8aa-2ec8-474e-8010-7451f045c3c1" returned: 0 in 0.457s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-9b98a8aa-2ec8-474e-8010-7451f045c3c1" released by "delete_volume" :: held 1.129s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:37 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de" returned: 0 in 0.633s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de Nov 05 08:24:37 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e4cd471a-db49-4fdb-9fb7-70714c26edac req-b0c3485c-934d-4f4a-b5be-71ea26a1c6e6 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e4cd471a-db49-4fdb-9fb7-70714c26edac req-b0c3485c-934d-4f4a-b5be-71ea26a1c6e6 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e4cd471a-db49-4fdb-9fb7-70714c26edac req-b0c3485c-934d-4f4a-b5be-71ea26a1c6e6 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Created reservations ['2ea679e8-49c6-4b92-9112-fa38c64afbdd', 'f53badd7-17d5-4c25-ab67-c8a70008f867', '9b1b8982-9c5f-499d-9ed5-ee57af629cfb', '1540a7cb-35f4-4a83-9f88-3cf42fa231a0'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-e4cd471a-db49-4fdb-9fb7-70714c26edac req-b0c3485c-934d-4f4a-b5be-71ea26a1c6e6 tempest-ServerActionsTestOtherA-1119472718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-da7ecd49-f196-442b-841a-64c7f445f1c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54e7e184-5fd8-408d-9ca8-37a60fc876b2', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-e4cd471a-db49-4fdb-9fb7-70714c26edac req-b0c3485c-934d-4f4a-b5be-71ea26a1c6e6 tempest-ServerActionsTestOtherA-1119472718 None] attachment_update completed successfully. Nov 05 08:24:37 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:37 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b08b3130-69df-4b7e-954b-984b2decd9de" returned: 0 in 0.305s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-b08b3130-69df-4b7e-954b-984b2decd9de" released by "delete_volume" :: held 1.006s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Created reservations ['e1a49446-694a-40a5-9df3-fe663c4f0bf3'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:37 devstack cinder-volume[87101]: WARNING cinder.quota [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-954362285 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-954362285, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:37 devstack cinder-volume[87101]: WARNING cinder.quota [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-954362285 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-954362285, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Created reservations ['5023b882-29b7-4933-81b7-32ccb4bee814', 'd8022755-2662-4b25-baba-0a7041411c45', 'caba0f28-7bb7-4431-b424-b60adfe2d662', '6c1360a0-47ca-4dcd-b394-0204532b68f5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:38 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.420s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Deleted volume successfully. Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ecb1a85-30c8-41d4-900e-694530d86e88 tempest-VolumesTestJSON-760145110 None] Lock "cinder-9b98a8aa-2ec8-474e-8010-7451f045c3c1-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:38 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:38 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:38 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a0effcd9-e2d3-4b2e-a5d2-69e0d753dbf3 tempest-GroupsTest-994133300 None] Delete group completed successfully. Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-d1e8baee-6644-4c69-be62-106a36f59ad8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "cinder-d1e8baee-6644-4c69-be62-106a36f59ad8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-quobyte-d1e8baee-6644-4c69-be62-106a36f59ad8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-d1e8baee-6644-4c69-be62-106a36f59ad8" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a1e44-1734-4b45-95d8-f74186d46b4f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:38 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 Nov 05 08:24:38 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:39 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:39 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8 Nov 05 08:24:39 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:39 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d1e8baee-6644-4c69-be62-106a36f59ad8" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-d1e8baee-6644-4c69-be62-106a36f59ad8" released by "delete_volume" :: held 0.760s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Created reservations ['e988ca49-0543-448c-9e71-edf56dd8c020', '1d8a27f5-9461-4f35-ab99-bcf76de68cee', '2c402969-819f-402f-8626-1c75fde8dbe4', '981257d6-81c0-4eb7-b1fa-3682f56a5329'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Created reservations ['5d2b7cb7-3f8b-4270-9cac-922d0eb268f5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:39 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:39 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:39 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:39 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-17196645-db45-495e-84b9-7fbf2f9fb2b6-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "cinder-17196645-db45-495e-84b9-7fbf2f9fb2b6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:40 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-334d0de3-f521-45ee-a020-ab633cd723bd tempest-GroupsTest-994133300 None] Delete group completed successfully. Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Acquiring lock "cinder-quobyte-17196645-db45-495e-84b9-7fbf2f9fb2b6" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-17196645-db45-495e-84b9-7fbf2f9fb2b6" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c08ecd-874c-42a2-ad39-0f661f5226a3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:40 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.533s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Deleted volume successfully. Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-27924a2a-e54c-4ab2-b674-033a35a6f6c5 tempest-VolumesTestJSON-760145110 None] Lock "cinder-d1e8baee-6644-4c69-be62-106a36f59ad8-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:40 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 Nov 05 08:24:40 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:40 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6" returned: 0 in 0.478s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:40 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6 Nov 05 08:24:40 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:41 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17196645-db45-495e-84b9-7fbf2f9fb2b6" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "cinder-quobyte-17196645-db45-495e-84b9-7fbf2f9fb2b6" released by "delete_volume" :: held 0.953s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Created reservations ['2b632422-52a6-4425-aaf2-ef631f840a74', '70ebd96c-a8f0-40ed-883f-6e2fe0781029', '8a247f7a-11b2-4b9e-b556-16668d3c96aa', '9f099646-5b6d-4ec2-b3e0-941107230875'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:41 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:41 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7ffd393e-9b3d-43a9-8077-7a8dc0bda42d tempest-GroupsTest-994133300 None] Group tempest-GroupsTest-Group-1401710548: creating Nov 05 08:24:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7ffd393e-9b3d-43a9-8077-7a8dc0bda42d tempest-GroupsTest-994133300 None] Group tempest-GroupsTest-Group-1401710548: created successfully Nov 05 08:24:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7ffd393e-9b3d-43a9-8077-7a8dc0bda42d tempest-GroupsTest-994133300 None] Create group completed successfully. Nov 05 08:24:41 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.357s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Deleted volume successfully. Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-897cb9a4-cdea-4ea5-b9f6-127a090d1388 tempest-VolumesTestJSON-760145110 None] Lock "cinder-17196645-db45-495e-84b9-7fbf2f9fb2b6-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-4c4a548e-dc4d-4292-8168-7e8576d6747b tempest-ServerActionsTestOtherA-1119472718 None] Terminate volume connection completed successfully. Nov 05 08:24:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-4c4a548e-dc4d-4292-8168-7e8576d6747b tempest-ServerActionsTestOtherA-1119472718 None] Deleting attachment 54e7e184-5fd8-408d-9ca8-37a60fc876b2. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:24:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-12871b05-996c-4435-ab25-a34b3ac2afb1 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-12871b05-996c-4435-ab25-a34b3ac2afb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-12871b05-996c-4435-ab25-a34b3ac2afb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-12871b05-996c-4435-ab25-a34b3ac2afb1 tempest-ServerActionsTestOtherA-1119472718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-da7ecd49-f196-442b-841a-64c7f445f1c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17acb399-d226-49c1-8a40-19c60747520e', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:24:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-f7714ed8-c01c-413b-852d-0a6354c36a1e req-12871b05-996c-4435-ab25-a34b3ac2afb1 tempest-ServerActionsTestOtherA-1119472718 None] attachment_update completed successfully. Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (7ac8cdfe-1427-4b79-8f7a-05c9768b346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e79c661-27ea-4ae5-be37-fb8c0fa971f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e79c661-27ea-4ae5-be37-fb8c0fa971f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1993402349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,host='devstack@QuobyteHD#QuobyteHD',id=a9368ac1-5449-4069-acbc-72393e3550c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:43Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7c69e5-ef3c-4098-a859-2d422601626c),volume_type_id=ef7c69e5-ef3c-4098-a859-2d422601626c)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857b752c-1db8-4991-b63d-c237a172f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857b752c-1db8-4991-b63d-c237a172f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd04a4-7440-4852-bca7-a5a4a5ff9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd04a4-7440-4852-bca7-a5a4a5ff9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9368ac1-5449-4069-acbc-72393e3550c8', 'volume_name': 'volume-a9368ac1-5449-4069-acbc-72393e3550c8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026c6593-0f5f-4977-a153-1dea960cec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026c6593-0f5f-4977-a153-1dea960cec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa01567-d85a-4ff5-b3d1-36fd7da11617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Volume a9368ac1-5449-4069-acbc-72393e3550c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9368ac1-5449-4069-acbc-72393e3550c8', 'volume_size': 1} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,created_at=2026-11-05T07:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1993402349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,host='devstack@QuobyteHD#QuobyteHD',id=a9368ac1-5449-4069-acbc-72393e3550c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:43Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7c69e5-ef3c-4098-a859-2d422601626c),volume_type_id=ef7c69e5-ef3c-4098-a859-2d422601626c)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Creating volume a9368ac1-5449-4069-acbc-72393e3550c8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:43 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:43 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 1073741824 Nov 05 08:24:43 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:44 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 1073741824" returned: 0 in 0.522s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:44 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 Nov 05 08:24:44 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:44 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa01567-d85a-4ff5-b3d1-36fd7da11617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9368ac1-5449-4069-acbc-72393e3550c8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e007b5-5769-41c5-b2e4-dd0859c9ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Volume volume-a9368ac1-5449-4069-acbc-72393e3550c8 (a9368ac1-5449-4069-acbc-72393e3550c8): created successfully Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e007b5-5769-41c5-b2e4-dd0859c9ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (7ac8cdfe-1427-4b79-8f7a-05c9768b346e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0157ec46-40aa-4e34-8b06-03519ea99ab4 tempest-GroupsTest-994133300 None] Created volume successfully. Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (c8a5e59f-ccd3-4ff7-91c8-fa52cbe469ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85199810-f208-4578-8a5e-31078f0f6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85199810-f208-4578-8a5e-31078f0f6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900171124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,host='devstack@QuobyteHD#QuobyteHD',id=7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:46Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7c69e5-ef3c-4098-a859-2d422601626c),volume_type_id=ef7c69e5-ef3c-4098-a859-2d422601626c)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57092e49-3749-48cb-930d-da47bbd78ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57092e49-3749-48cb-930d-da47bbd78ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe75e8af-af37-42bd-85ca-7d9ece0c0aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe75e8af-af37-42bd-85ca-7d9ece0c0aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf', 'volume_name': 'volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a8be1c-8221-49a6-8f05-6809f6b8b589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a8be1c-8221-49a6-8f05-6809f6b8b589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9cb183-b7d7-4826-befb-b942ab029929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Volume 7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf', 'volume_size': 1} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,created_at=2026-11-05T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900171124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd7a2381-1f02-40a0-a84e-bae975b477fb,host='devstack@QuobyteHD#QuobyteHD',id=7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feba828302034466a01ce52cb607bde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:46Z,use_quota=True,user_id='2f2cee8fdf6a4877b45af2b0c918fece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7c69e5-ef3c-4098-a859-2d422601626c),volume_type_id=ef7c69e5-ef3c-4098-a859-2d422601626c)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Creating volume 7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:45 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:45 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf 1073741824 Nov 05 08:24:45 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:46 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf 1073741824" returned: 0 in 0.490s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:46 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf Nov 05 08:24:46 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:46 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9cb183-b7d7-4826-befb-b942ab029929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8a831b-fd4e-408f-8ce8-5c5a1471259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Volume volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf (7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf): created successfully Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8a831b-fd4e-408f-8ce8-5c5a1471259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Flow 'volume_create_manager' (c8a5e59f-ccd3-4ff7-91c8-fa52cbe469ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-519b641b-32c6-4071-aa83-6d0adaf282e2 tempest-GroupsTest-994133300 None] Created volume successfully. Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:48 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:48 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1223e3b3-9471-4657-a5eb-ba7118212788 tempest-GroupsTest-994133300 None] Update group completed successfully. Nov 05 08:24:48 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-525e332f-15d4-4cba-9bdf-83c3ac20bb6f tempest-GroupsTest-994133300 None] Update group completed successfully. Nov 05 08:24:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Acquiring lock "cinder-quobyte-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:51 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ad5ef-9ec7-4ce0-ac1f-c64f6b35968e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:51 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf Nov 05 08:24:51 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:52 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" returned: 0 in 0.573s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:52 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf Nov 05 08:24:52 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:52 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" returned: 0 in 0.635s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-7b0af718-ab7a-435f-a7b5-9fafe7dd1fcf" released by "delete_volume" :: held 1.297s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Acquiring lock "cinder-quobyte-a9368ac1-5449-4069-acbc-72393e3550c8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-a9368ac1-5449-4069-acbc-72393e3550c8" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63b697-83eb-45ed-af22-b19d97a545d4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:53 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 Nov 05 08:24:53 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:53 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8" returned: 0 in 0.647s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:53 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8 Nov 05 08:24:53 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:54 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a9368ac1-5449-4069-acbc-72393e3550c8" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "cinder-quobyte-a9368ac1-5449-4069-acbc-72393e3550c8" released by "delete_volume" :: held 1.136s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Created reservations ['b66e5321-a25c-4a79-9f13-4ea739b9ef15'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:54 devstack cinder-volume[87101]: WARNING cinder.quota [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-161299107 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-161299107, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:54 devstack cinder-volume[87101]: WARNING cinder.quota [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-161299107 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-161299107, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Created reservations ['cd72d568-4e6f-47ce-972c-81b4fadec2c2', 'fcee4f45-097d-4692-a47f-12253d4c9170', '1493c719-5230-4907-90c9-78235840d66c', '07cd7ae6-34d1-48c0-9e96-32a39bb25f39'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Created reservations ['b0e20795-eb85-42d9-94c2-3b7ea8feaee0', 'dd05af2c-77ce-41a1-bd4c-a00ea692160b', '5eaea6c8-5f97-4d4b-9ceb-f8b47b617a15', 'fbd4de9a-9e1e-4096-9bde-a95bc8669fc2'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:55 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:24:55 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:55 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.394s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:55 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c1b40648-bd77-4e5b-8ee4-51ba571ae022 tempest-GroupsTest-994133300 None] Delete group completed successfully. Nov 05 08:24:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6947b737-8b51-4b9c-b96f-59bdb2da5f6b tempest-GroupsV314Test-2069761583 None] Group tempest-GroupsV314Test-Group-1700292773: creating Nov 05 08:24:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6947b737-8b51-4b9c-b96f-59bdb2da5f6b tempest-GroupsV314Test-2069761583 None] Group tempest-GroupsV314Test-Group-1700292773: created successfully Nov 05 08:24:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6947b737-8b51-4b9c-b96f-59bdb2da5f6b tempest-GroupsV314Test-2069761583 None] Create group completed successfully. Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Flow 'volume_create_manager' (7dd81d74-d6a4-4c2d-9fe0-de8c53b28bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bd5bfd-d7f6-45dc-b9fa-a477f01d8f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bd5bfd-d7f6-45dc-b9fa-a477f01d8f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878581219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce4827cf-cfce-4f93-934c-4b4c04ba2e62,host='devstack@QuobyteHD#QuobyteHD',id=25b23a15-a078-4e2a-a974-adf7b272361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa60e393d35440fa27266fbf8af06d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:59Z,use_quota=True,user_id='d2c5d5dab9bc41c49f7e59cac53eb056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7014d48-4720-484f-8f52-fdaac0448f51),volume_type_id=f7014d48-4720-484f-8f52-fdaac0448f51)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e3864d-79af-4c9f-a382-0e8b88ad3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e3864d-79af-4c9f-a382-0e8b88ad3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27d57-59e4-4bbc-be16-26479d5c9a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27d57-59e4-4bbc-be16-26479d5c9a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b23a15-a078-4e2a-a974-adf7b272361b', 'volume_name': 'volume-25b23a15-a078-4e2a-a974-adf7b272361b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3f29c7-51ac-40a6-a9f4-8f464463162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3f29c7-51ac-40a6-a9f4-8f464463162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb658b59-f9e0-4c1c-8146-51eeab6d292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Volume 25b23a15-a078-4e2a-a974-adf7b272361b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b23a15-a078-4e2a-a974-adf7b272361b', 'volume_size': 1} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce4827cf-cfce-4f93-934c-4b4c04ba2e62,created_at=2026-11-05T07:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878581219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce4827cf-cfce-4f93-934c-4b4c04ba2e62,host='devstack@QuobyteHD#QuobyteHD',id=25b23a15-a078-4e2a-a974-adf7b272361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa60e393d35440fa27266fbf8af06d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:59Z,use_quota=True,user_id='d2c5d5dab9bc41c49f7e59cac53eb056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7014d48-4720-484f-8f52-fdaac0448f51),volume_type_id=f7014d48-4720-484f-8f52-fdaac0448f51)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Creating volume 25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:59 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:59 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b 1073741824 Nov 05 08:24:59 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:59 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b 1073741824" returned: 0 in 0.746s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:00 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:00 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:00 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.332s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb658b59-f9e0-4c1c-8146-51eeab6d292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b23a15-a078-4e2a-a974-adf7b272361b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46b345e-0ab3-4a65-b8ba-41c7abbb5b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Volume volume-25b23a15-a078-4e2a-a974-adf7b272361b (25b23a15-a078-4e2a-a974-adf7b272361b): created successfully Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46b345e-0ab3-4a65-b8ba-41c7abbb5b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Flow 'volume_create_manager' (7dd81d74-d6a4-4c2d-9fe0-de8c53b28bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4ad64889-0928-4aaf-866f-6018b87970bc tempest-GroupsV314Test-2069761583 None] Created volume successfully. Nov 05 08:25:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:02 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Cloning volume 25b23a15-a078-4e2a-a974-adf7b272361b to volume 17bcbeab-9835-4edf-821b-37650c08538d Nov 05 08:25:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Creating offline snapshot ae034f0f-e4ca-4750-8579-766e284c3685 of volume 25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab2a27-2190-42f4-b5d2-065b832ed012]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:02 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:02 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:03 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.672s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:03 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 1G Nov 05 08:25:03 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:03 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 1G" returned: 0 in 0.619s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b23a15-a078-4e2a-a974-adf7b272361b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:03 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b23a15-a078-4e2a-a974-adf7b272361b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:03 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:04 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b23a15-a078-4e2a-a974-adf7b272361b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:04 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:04 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:04 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:04 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:04 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info Nov 05 08:25:04 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:04 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info" returned: 0 in 0.304s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:04 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:25:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:04 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info Nov 05 08:25:04 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:05 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.info" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Acquiring lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] snapshot: ae034f0f-e4ca-4750-8579-766e284c3685, volume: 17bcbeab-9835-4edf-821b-37650c08538d, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f769d-de9f-4980-8f6f-f9155544ebee]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:05 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:05 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:05 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.474s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b23a15-a078-4e2a-a974-adf7b272361b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8850538-4f08-4ea3-b5ab-d21c4eafc6d7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:05 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:05 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:06 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.511s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:25:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:25:06 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:25:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:06 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d Nov 05 08:25:06 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-881023c7-e8c3-4890-b294-69b1627ef523 req-1f461cba-5a67-44fa-a166-d474a5e514f7 tempest-ServerActionsTestOtherA-1119472718 None] Terminate volume connection completed successfully. Nov 05 08:25:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-881023c7-e8c3-4890-b294-69b1627ef523 req-1f461cba-5a67-44fa-a166-d474a5e514f7 tempest-ServerActionsTestOtherA-1119472718 None] Deleting attachment 17acb399-d226-49c1-8a40-19c60747520e. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:25:19 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d" returned: 0 in 13.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:19 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b, size 1024.00 MB, duration 13.30 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:25:19 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Converted 1024.00 MB image at 77.00 MB/s Nov 05 08:25:19 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:25:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:19 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d Nov 05 08:25:19 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:20 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d" returned: 0 in 0.725s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" released by "_copy_volume_from_snapshot" :: held 15.137s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Acquiring lock "cinder-quobyte-ae034f0f-e4ca-4750-8579-766e284c3685" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-ae034f0f-e4ca-4750-8579-766e284c3685" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Deleting offline snapshot ae034f0f-e4ca-4750-8579-766e284c3685 of volume 25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] snapshot_file for this snap is: volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a932072d-2175-4021-a5c9-0314e82ddad5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:20 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:20 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:21 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.573s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b23a15-a078-4e2a-a974-adf7b272361b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[735deccd-23e8-4a4e-8c5e-abd15b1c7a19]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:21 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:21 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:21 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.806s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:21 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:21 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Flow 'volume_create_manager' (624a766e-23ab-4f5d-b4a3-79607196a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66a67a-3861-49fc-9fda-7a08cf376b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66a67a-3861-49fc-9fda-7a08cf376b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-917155444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622b88b8-99d8-46b5-bfbf-203a0d2066ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb81d93d3324f50818f5c17e7e183c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:22Z,use_quota=True,user_id='fcfab55adfe243a1aa1ed415b149f74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba72c4f-5db9-4d82-a5fd-4121030bdd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba72c4f-5db9-4d82-a5fd-4121030bdd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5928236-b4bd-4594-9b81-a2671acf43fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5928236-b4bd-4594-9b81-a2671acf43fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622b88b8-99d8-46b5-bfbf-203a0d2066ff', 'volume_name': 'volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb58efe9-c3d8-4c3a-afff-2f42fdc7c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb58efe9-c3d8-4c3a-afff-2f42fdc7c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937210f8-39ab-4f88-a8f7-333c175e9ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:22 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff', 'volume_size': 1} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:22 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:22 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685 Nov 05 08:25:22 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:22 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b.ae034f0f-e4ca-4750-8579-766e284c3685" returned: 0 in 0.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-ae034f0f-e4ca-4750-8579-766e284c3685" released by "_delete_snapshot" :: held 2.293s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.337s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-917155444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622b88b8-99d8-46b5-bfbf-203a0d2066ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb81d93d3324f50818f5c17e7e183c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:22Z,use_quota=True,user_id='fcfab55adfe243a1aa1ed415b149f74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Creating volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:22 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:25:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:22 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff 1073741824 Nov 05 08:25:22 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6a1951da-b3a6-408a-9883-7f8e094c6d3f tempest-GroupsV314Test-2069761583 None] Create group from source-group-ce4827cf-cfce-4f93-934c-4b4c04ba2e62 completed successfully. Nov 05 08:25:23 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff 1073741824" returned: 0 in 0.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:23 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff Nov 05 08:25:23 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:23 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937210f8-39ab-4f88-a8f7-333c175e9ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4f913c-77e1-4a14-93a3-9ae6c0800aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:23 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Volume volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff (622b88b8-99d8-46b5-bfbf-203a0d2066ff): created successfully Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4f913c-77e1-4a14-93a3-9ae6c0800aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Flow 'volume_create_manager' (624a766e-23ab-4f5d-b4a3-79607196a376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7dc8f03a-2793-4435-8b6c-8defcd0cef53 tempest-SnapshotsActionsTest-1762879222 None] Created volume successfully. Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Flow 'volume_create_manager' (febf4be3-e76a-4590-9d67-ebeb390a7962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bcca95-4600-4fe5-97f6-1690b72dff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bcca95-4600-4fe5-97f6-1690b72dff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1878926258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4042317b-2e07-455d-afb0-1bb55308515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b9d3661403449bac89b06ab56dbdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:24Z,use_quota=True,user_id='5c588c81ce0842278b00a35e85e46fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a84b8b-eedb-4dc5-866a-e50e4ba06da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a84b8b-eedb-4dc5-866a-e50e4ba06da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231794fc-9e51-460a-869b-aa40a98af298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Acquiring lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Creating offline snapshot 83eb21bd-cb51-448d-a961-7b32275de708 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[39427680-0235-4598-b2f0-ad1a431b6a8c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a469e-7831-4fc8-9237-75089b564bd4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:24 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d Nov 05 08:25:24 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:24 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff Nov 05 08:25:24 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231794fc-9e51-460a-869b-aa40a98af298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4042317b-2e07-455d-afb0-1bb55308515d', 'volume_name': 'volume-4042317b-2e07-455d-afb0-1bb55308515d', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd5c1c8-cf86-4428-9a06-9a54d7efb12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd5c1c8-cf86-4428-9a06-9a54d7efb12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931f8a48-41f1-4bef-b9f2-92bb2a72e6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:24 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Volume 4042317b-2e07-455d-afb0-1bb55308515d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4042317b-2e07-455d-afb0-1bb55308515d', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Trying to clone 4042317b-2e07-455d-afb0-1bb55308515d from image 0f972b89-5809-49af-bb61-4f969e240750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:25:24 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d" returned: 0 in 0.454s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:24 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d Nov 05 08:25:24 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:24 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff" returned: 0 in 0.501s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 1G Nov 05 08:25:25 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:25:25 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45c039-8773-42b6-b841-4d6b83a61e2e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-17bcbeab-9835-4edf-821b-37650c08538d" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-17bcbeab-9835-4edf-821b-37650c08538d" released by "delete_volume" :: held 0.868s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Created reservations ['b77b4701-f1e4-4a63-a3d6-33662421b71d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:25 devstack cinder-volume[87101]: WARNING cinder.quota [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1968324408 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1968324408, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:25:25 devstack cinder-volume[87101]: WARNING cinder.quota [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1968324408 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1968324408, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Created reservations ['11211fa3-7cfd-4945-9b0e-c03b447dab91', 'fe249d1c-a159-4c37-869f-d8c1a6cc20f3', '3d085ef9-238b-4b0e-a08e-74c45894621d', '01b232dd-118e-4022-992a-eaaf51e3ce5a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:25 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD Nov 05 08:25:25 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 1G" returned: 0 in 0.549s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:25 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:25:25 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 is fetched for user 5c588c81ce0842278b00a35e85e46fcd. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e09c1ae-359d-4526-8d7c-2bd56dd76ba4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:25 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d5f1773a-b1f1-40e1-a212-486010edc378 tempest-GroupsV314Test-2069761583 None] Delete group completed successfully. Nov 05 08:25:25 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:25 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD Nov 05 08:25:25 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.350s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:25 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 is being set with open permissions: ugo+rw Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:25 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:25 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Acquiring lock "cinder-quobyte-25b23a15-a078-4e2a-a974-adf7b272361b" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-25b23a15-a078-4e2a-a974-adf7b272361b" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aeeb3e-1e02-44f5-b332-a20d3e310d45]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:26 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:26 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info Nov 05 08:25:26 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:26 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info" returned: 0 in 0.265s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info is being set with open permissions: ugo+rw Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b Nov 05 08:25:26 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:26 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info Nov 05 08:25:26 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:26 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.info" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1878926258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4042317b-2e07-455d-afb0-1bb55308515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b9d3661403449bac89b06ab56dbdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:24Z,use_quota=True,user_id='5c588c81ce0842278b00a35e85e46fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Creating volume 4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:26 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-25b23a15-a078-4e2a-a974-adf7b272361b" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:26 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1073741824 Nov 05 08:25:26 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Lock "cinder-quobyte-25b23a15-a078-4e2a-a974-adf7b272361b" released by "delete_volume" :: held 0.814s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-846c9947-a8a8-42aa-92a2-e96a9005b3ea tempest-SnapshotsActionsTest-1762879222 None] Create snapshot completed successfully Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Created reservations ['1f7d293e-650a-4a52-8aeb-5aada7d9b152'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Created reservations ['3fc3dd87-8e49-4588-857f-06d9fe70fe61', '3a01e40f-449f-4c96-8046-ba4681b2a378', 'de4279fa-b916-40dd-88ca-6c8fa321686b', '0a71d2bb-60ad-4497-b0ea-130cddcdf50c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:27 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:25:27 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:27 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1073741824" returned: 0 in 0.494s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:27 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bd2c8b5d-3e5c-4b19-aeff-2f36cab03153 tempest-GroupsV314Test-2069761583 None] Delete group completed successfully. Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:27 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d Nov 05 08:25:27 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:27 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Attempting download of 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 4042317b-2e07-455d-afb0-1bb55308515d. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4839dcd2-7ded-413d-84b5-51787c3950c3]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:27 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci Nov 05 08:25:27 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:28 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci" returned: 0 in 0.374s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=111,cinder:UPDATE=116,cinder:DELETE=4,cinder:INSERT=28 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=114,cinder:UPDATE=119,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:28 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci Nov 05 08:25:28 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Creating offline snapshot d06823e8-5574-46bf-b26f-f55e2c926c83 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095b695-acbd-433c-96b2-3685aa6fc386]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:28 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:28 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:28 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci" returned: 1 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_1f7tvtci' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6245aa57-5902-4c78-9a4d-6f5900038805]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:28 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD Nov 05 08:25:28 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:28 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:28 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 1G Nov 05 08:25:28 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:28 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] 0f972b89-5809-49af-bb61-4f969e240750 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:25:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:28 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d Nov 05 08:25:28 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:29 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 1G" returned: 0 in 0.532s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:29 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 Nov 05 08:25:29 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:29 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83" returned: 0 in 0.352s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:29 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 is being set with open permissions: ugo+rw Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:29 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 Nov 05 08:25:29 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:29 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.744s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-28aa26ee-3bab-4fb3-ae22-b01c603ec191 tempest-SnapshotsActionsTest-1762879222 None] Create snapshot completed successfully Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-d06823e8-5574-46bf-b26f-f55e2c926c83-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-d06823e8-5574-46bf-b26f-f55e2c926c83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-d06823e8-5574-46bf-b26f-f55e2c926c83" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-d06823e8-5574-46bf-b26f-f55e2c926c83" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Deleting offline snapshot d06823e8-5574-46bf-b26f-f55e2c926c83 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] snapshot_file for this snap is: volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97bc5a4-03e3-48f5-939b-9dc076599624]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:30 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 Nov 05 08:25:30 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:31 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d" returned: 0 in 2.226s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_f83ajt6adevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:25:31 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Converted 112.00 MB image at 50.29 MB/s Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:31 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:31 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1G Nov 05 08:25:31 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[54178ff2-5e31-42d1-834e-a58adf3d0304]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:31 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:31 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:31 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d 1G" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Downloaded image 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 4042317b-2e07-455d-afb0-1bb55308515d successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 for user 5c588c81ce0842278b00a35e85e46fcd is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Marking volume 4042317b-2e07-455d-afb0-1bb55308515d as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Copying metadata from image 0f972b89-5809-49af-bb61-4f969e240750 to 4042317b-2e07-455d-afb0-1bb55308515d. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Creating volume glance metadata for volume 4042317b-2e07-455d-afb0-1bb55308515d backed by image 0f972b89-5809-49af-bb61-4f969e240750 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:25:31 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.444s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:31 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 Nov 05 08:25:31 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931f8a48-41f1-4bef-b9f2-92bb2a72e6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4042317b-2e07-455d-afb0-1bb55308515d', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f9d4a2-0864-4ea3-a010-0e04e0f7006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Volume volume-4042317b-2e07-455d-afb0-1bb55308515d (4042317b-2e07-455d-afb0-1bb55308515d): created successfully Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f9d4a2-0864-4ea3-a010-0e04e0f7006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Flow 'volume_create_manager' (febf4be3-e76a-4590-9d67-ebeb390a7962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-39e8edd1-7265-4c67-a634-c963a0c78eb1 tempest-ServerActionsTestOtherA-1119472718 None] Created volume successfully. Nov 05 08:25:32 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83" returned: 0 in 0.495s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:32 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83 Nov 05 08:25:32 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:32 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.d06823e8-5574-46bf-b26f-f55e2c926c83" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-d06823e8-5574-46bf-b26f-f55e2c926c83" released by "_delete_snapshot" :: held 1.735s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_snapshot" :: held 1.760s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Created reservations ['82772763-b3b8-4ffe-aed9-b455a22ae601', 'b5f8a570-05c1-4e40-ab17-e5c640c140cc', 'bc9be618-b68a-4c12-acb4-ceb4c5a5e259', '126a4d83-a8a0-43a9-ae65-0c1d8b49ef55'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:32 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Delete snapshot completed successfully. Nov 05 08:25:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e58c82ab-26a1-4df1-83e0-bdd98deb33f0 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-d06823e8-5574-46bf-b26f-f55e2c926c83-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Creating offline snapshot eee70d68-c5ce-400e-be83-c0083777f754 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ec9c9-5567-494b-8fdc-20a3253d4e4e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:33 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:33 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:33 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.456s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:33 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 1G Nov 05 08:25:33 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-809a1575-8993-4c34-89e3-48746496210c tempest-GroupsV320Test-1306466608 None] Group tempest-GroupsV320Test-Group-1485850165: creating Nov 05 08:25:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-809a1575-8993-4c34-89e3-48746496210c tempest-GroupsV320Test-1306466608 None] Group tempest-GroupsV320Test-Group-1485850165: created successfully Nov 05 08:25:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-809a1575-8993-4c34-89e3-48746496210c tempest-GroupsV320Test-1306466608 None] Create group completed successfully. Nov 05 08:25:34 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 1G" returned: 0 in 0.546s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:34 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 Nov 05 08:25:34 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:34 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754" returned: 0 in 0.296s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:34 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 is being set with open permissions: ugo+rw Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:34 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 Nov 05 08:25:34 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:34 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.673s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0827740b-246e-4b9f-b17c-b970daac40ac tempest-SnapshotsActionsTest-1762879222 None] Create snapshot completed successfully Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-eee70d68-c5ce-400e-be83-c0083777f754-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-eee70d68-c5ce-400e-be83-c0083777f754-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-eee70d68-c5ce-400e-be83-c0083777f754" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-eee70d68-c5ce-400e-be83-c0083777f754" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Deleting offline snapshot eee70d68-c5ce-400e-be83-c0083777f754 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] snapshot_file for this snap is: volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03aacd-d04c-4e94-94ed-9b1dfce9affc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0b159129-ef41-41d5-a1f6-5e585ceb6479 req-7af7f58b-5476-4af2-8aec-af5ff3eee852 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0b159129-ef41-41d5-a1f6-5e585ceb6479 req-7af7f58b-5476-4af2-8aec-af5ff3eee852 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-0b159129-ef41-41d5-a1f6-5e585ceb6479 req-7af7f58b-5476-4af2-8aec-af5ff3eee852 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0b159129-ef41-41d5-a1f6-5e585ceb6479 req-7af7f58b-5476-4af2-8aec-af5ff3eee852 tempest-ServerActionsTestOtherA-1119472718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-4042317b-2e07-455d-afb0-1bb55308515d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78a3c5b9-e4ca-4da1-9d82-015e53d91b63', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:35 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 Nov 05 08:25:35 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-0b159129-ef41-41d5-a1f6-5e585ceb6479 req-7af7f58b-5476-4af2-8aec-af5ff3eee852 tempest-ServerActionsTestOtherA-1119472718 None] attachment_update completed successfully. Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Created reservations ['47054d83-d61a-4db6-831e-30ee03e00aca'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:35 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:25:35 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:36 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754" returned: 0 in 0.593s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0133d7-8191-429f-af50-30d410076327]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:36 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.338s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5ef54e32-66bf-4320-9652-c2cbf3301963 tempest-GroupsV320Test-1306466608 None] Delete group completed successfully. Nov 05 08:25:36 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:36 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:36 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:36 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 Nov 05 08:25:36 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:36 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:37 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754 Nov 05 08:25:37 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:37 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.eee70d68-c5ce-400e-be83-c0083777f754" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-eee70d68-c5ce-400e-be83-c0083777f754" released by "_delete_snapshot" :: held 1.884s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_snapshot" :: held 1.907s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Created reservations ['b1c6673f-a771-447e-a4ec-8be8f0ade92e', '6356a993-8a6e-473a-bbd6-597baee43cd1', 'b9b583e7-13a8-4a55-ac2f-f66e0475de4d', '013b1570-dfd9-41d9-aadf-e549ad20272b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:37 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Delete snapshot completed successfully. Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c0d6a67a-f6c2-4f9a-badf-dae568f57fc4 tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-eee70d68-c5ce-400e-be83-c0083777f754-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Creating offline snapshot 5c63be4e-39d7-4882-92d5-6849241e9297 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:38 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7738f2db-5159-41e1-abc0-bb822e3c64f7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:38 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:38 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:38 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.690s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:38 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 1G Nov 05 08:25:38 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:39 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 1G" returned: 0 in 0.663s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:39 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 Nov 05 08:25:39 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:39 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297" returned: 0 in 0.416s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:39 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 is being set with open permissions: ugo+rw Nov 05 08:25:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:39 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 Nov 05 08:25:39 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:40 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ec0f16eb-c144-46cc-82a1-0b6b22f48b06 tempest-SnapshotsActionsTest-1762879222 None] Create snapshot completed successfully Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (080e87a3-5d52-484a-995d-758faa4f140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba58faf2-43f1-4636-b35a-41e7c49dc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba58faf2-43f1-4636-b35a-41e7c49dc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1802164432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:40Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659f9e7d-b60a-461d-8a32-ba7331d957c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659f9e7d-b60a-461d-8a32-ba7331d957c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d5823f-4e75-4277-9e7d-26eb21f553ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d5823f-4e75-4277-9e7d-26eb21f553ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc', 'volume_name': 'volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba3a40b-5e01-4efa-9920-d113bc67f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba3a40b-5e01-4efa-9920-d113bc67f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f61357-fb0d-414c-820e-64e9cb24ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Volume 4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc', 'volume_size': 1} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1802164432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:40Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Creating volume 4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:40 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:25:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:40 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc 1073741824 Nov 05 08:25:40 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc 1073741824" returned: 0 in 0.603s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:41 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc Nov 05 08:25:41 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-5c63be4e-39d7-4882-92d5-6849241e9297-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-5c63be4e-39d7-4882-92d5-6849241e9297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-5c63be4e-39d7-4882-92d5-6849241e9297" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-5c63be4e-39d7-4882-92d5-6849241e9297" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Deleting offline snapshot 5c63be4e-39d7-4882-92d5-6849241e9297 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] snapshot_file for this snap is: volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7507c6-7350-4a12-a7ed-e87476820adb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:41 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" returned: 0 in 0.449s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:41 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 Nov 05 08:25:41 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f61357-fb0d-414c-820e-64e9cb24ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06345c-1af4-4177-be27-d264f6a32fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Volume volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc (4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc): created successfully Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06345c-1af4-4177-be27-d264f6a32fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (080e87a3-5d52-484a-995d-758faa4f140d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f036d2e5-828e-40a7-9f6c-581ad737e0f9 tempest-AttachVolumeTestJSON-1774921419 None] Created volume successfully. Nov 05 08:25:42 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297" returned: 0 in 0.577s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f8624-9c64-4ac8-80c4-2b20acf4b408]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:42 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:42 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:42 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.739s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:42 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 Nov 05 08:25:42 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:43 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297" returned: 0 in 0.892s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:43 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297 Nov 05 08:25:43 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-926f69d1-a313-47fb-8d07-246714ff136c req-93fbbc2e-9d80-4506-952c-49e944c456b9 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-926f69d1-a313-47fb-8d07-246714ff136c req-93fbbc2e-9d80-4506-952c-49e944c456b9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-926f69d1-a313-47fb-8d07-246714ff136c req-93fbbc2e-9d80-4506-952c-49e944c456b9 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-926f69d1-a313-47fb-8d07-246714ff136c req-93fbbc2e-9d80-4506-952c-49e944c456b9 tempest-AttachVolumeTestJSON-1774921419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72f61bd5-3ded-47ec-ae46-4541e097c682', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-926f69d1-a313-47fb-8d07-246714ff136c req-93fbbc2e-9d80-4506-952c-49e944c456b9 tempest-AttachVolumeTestJSON-1774921419 None] attachment_update completed successfully. Nov 05 08:25:44 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.5c63be4e-39d7-4882-92d5-6849241e9297" returned: 0 in 0.463s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-5c63be4e-39d7-4882-92d5-6849241e9297" released by "_delete_snapshot" :: held 2.831s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_snapshot" :: held 2.871s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:44 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Created reservations ['e71c88ef-770a-468e-b4a3-7f6a979d2dae', '836cc94a-164e-4acb-b01d-b87200469fc1', '3c231959-3fce-4466-a550-a8c016f00f32', 'c4c6903f-a01d-4a29-9a70-fc66839ebc07'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Delete snapshot completed successfully. Nov 05 08:25:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6cf89601-9aff-49eb-9e05-d2af21e9862b tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-5c63be4e-39d7-4882-92d5-6849241e9297-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Creating offline snapshot 08b7710f-b233-406d-8a92-60d7a9404f4a of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebb1b5-1805-46b8-9a0a-39ce32da249e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:45 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:45 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:46 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.605s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:46 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a 1G Nov 05 08:25:46 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:47 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a 1G" returned: 0 in 0.974s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:47 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a Nov 05 08:25:47 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (2ff21603-e536-4298-b356-74cd2c825b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3c3b5c-5c9d-4d22-bc1f-dbeb673b6783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3c3b5c-5c9d-4d22-bc1f-dbeb673b6783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1910293525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c6d75b-8dfe-4208-b7d2-a20c98101370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:47Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b000049b-7579-4989-a740-a2eb47973513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b000049b-7579-4989-a740-a2eb47973513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ac0e0-75ad-420c-9fe8-5c400de8954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ac0e0-75ad-420c-9fe8-5c400de8954f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c6d75b-8dfe-4208-b7d2-a20c98101370', 'volume_name': 'volume-03c6d75b-8dfe-4208-b7d2-a20c98101370', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3029c0-962e-4700-bf7b-e2e2602438fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3029c0-962e-4700-bf7b-e2e2602438fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5637eb-a319-4b03-8fe1-98b3ba389930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Volume 03c6d75b-8dfe-4208-b7d2-a20c98101370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c6d75b-8dfe-4208-b7d2-a20c98101370', 'volume_size': 1} Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:47 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a" returned: 0 in 0.490s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:47 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a is being set with open permissions: ugo+rw Nov 05 08:25:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:47 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a Nov 05 08:25:47 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:48 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1910293525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c6d75b-8dfe-4208-b7d2-a20c98101370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934d30a8acbd425a92bee84608c7ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:47Z,use_quota=True,user_id='e48d2c6075214fb29fc1be40ed2e3c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Creating volume 03c6d75b-8dfe-4208-b7d2-a20c98101370 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:48 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:48 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 1073741824 Nov 05 08:25:48 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ef429372-6427-43ab-81ae-3f992010d797 tempest-SnapshotsActionsTest-1762879222 None] Create snapshot completed successfully Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:48 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:25:48 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:48 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 1073741824" returned: 0 in 0.632s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:48 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 Nov 05 08:25:48 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:48 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.456s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:25:49 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-08b7710f-b233-406d-8a92-60d7a9404f4a-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370" returned: 0 in 0.605s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5637eb-a319-4b03-8fe1-98b3ba389930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c6d75b-8dfe-4208-b7d2-a20c98101370', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596147ec-5fb7-49da-bbb8-b7dc3785e613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-08b7710f-b233-406d-8a92-60d7a9404f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Acquiring lock "cinder-quobyte-08b7710f-b233-406d-8a92-60d7a9404f4a" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:49 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Volume volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 (03c6d75b-8dfe-4208-b7d2-a20c98101370): created successfully Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596147ec-5fb7-49da-bbb8-b7dc3785e613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Flow 'volume_create_manager' (2ff21603-e536-4298-b356-74cd2c825b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d74ce710-e71a-47f1-b59d-4d2440418d06 tempest-AttachVolumeTestJSON-1774921419 None] Created volume successfully. Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-08b7710f-b233-406d-8a92-60d7a9404f4a" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Deleting offline snapshot 08b7710f-b233-406d-8a92-60d7a9404f4a of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] snapshot_file for this snap is: volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc23739-9d44-4c2d-a3f6-75463770d0e3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:49 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a Nov 05 08:25:49 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:50 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a" returned: 0 in 0.684s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e92c593-6f7b-4b0e-a667-0078637b6faf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:50 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:50 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:50 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.574s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:50 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a Nov 05 08:25:50 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:51 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a" returned: 0 in 0.640s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:51 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a Nov 05 08:25:51 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c00e9da1-654f-415c-b3fe-64923fa923cc req-10d5fbb0-9424-4eb6-9f13-c3f112bf6495 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c00e9da1-654f-415c-b3fe-64923fa923cc req-10d5fbb0-9424-4eb6-9f13-c3f112bf6495 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c00e9da1-654f-415c-b3fe-64923fa923cc req-10d5fbb0-9424-4eb6-9f13-c3f112bf6495 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c00e9da1-654f-415c-b3fe-64923fa923cc req-10d5fbb0-9424-4eb6-9f13-c3f112bf6495 tempest-AttachVolumeTestJSON-1774921419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-03c6d75b-8dfe-4208-b7d2-a20c98101370', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73ace2bf-9836-4deb-9fad-88ed21d53fa3', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:51 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.08b7710f-b233-406d-8a92-60d7a9404f4a" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-08b7710f-b233-406d-8a92-60d7a9404f4a" released by "_delete_snapshot" :: held 2.477s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_snapshot" :: held 2.549s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-c00e9da1-654f-415c-b3fe-64923fa923cc req-10d5fbb0-9424-4eb6-9f13-c3f112bf6495 tempest-AttachVolumeTestJSON-1774921419 None] attachment_update completed successfully. Nov 05 08:25:52 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Created reservations ['c5df1db5-8120-4f4a-a91c-2a7080668762', '145d2191-e831-4e2c-948f-336e1238183f', '8d81b322-a01a-4b1e-8261-54b93cd2349c', '930e24a8-ae16-454f-8f66-7c4e94921be3'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Delete snapshot completed successfully. Nov 05 08:25:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ba58ea9b-915a-42ee-bd8d-4270ee583bdc tempest-SnapshotsActionsTest-1330876521 None] Lock "cinder-08b7710f-b233-406d-8a92-60d7a9404f4a-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-bf6068e8-0656-4feb-9821-c60d722175cb req-b832adf8-5b52-4906-83fd-956a59f37780 tempest-ServerActionsTestOtherA-1119472718 None] Terminate volume connection completed successfully. Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-bf6068e8-0656-4feb-9821-c60d722175cb req-b832adf8-5b52-4906-83fd-956a59f37780 tempest-ServerActionsTestOtherA-1119472718 None] Deleting attachment 78a3c5b9-e4ca-4da1-9d82-015e53d91b63. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "cinder-83eb21bd-cb51-448d-a961-7b32275de708-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-83eb21bd-cb51-448d-a961-7b32275de708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "cinder-quobyte-83eb21bd-cb51-448d-a961-7b32275de708" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-83eb21bd-cb51-448d-a961-7b32275de708" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Deleting offline snapshot 83eb21bd-cb51-448d-a961-7b32275de708 of volume 622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] snapshot_file for this snap is: volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[76028ee5-755a-449e-a12a-23ff017ef258]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:54 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:54 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:54 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.497s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e6efd-b35d-4251-942a-c97be4eddf7b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:54 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff Nov 05 08:25:54 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-4374acb1-b6e5-4dbe-87ac-96f196265ed7 req-1f2d0d7e-3235-44b8-b3f6-0fe625c13fde tempest-AttachVolumeTestJSON-1774921419 None] Terminate volume connection completed successfully. Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-4374acb1-b6e5-4dbe-87ac-96f196265ed7 req-1f2d0d7e-3235-44b8-b3f6-0fe625c13fde tempest-AttachVolumeTestJSON-1774921419 None] Deleting attachment 72f61bd5-3ded-47ec-ae46-4541e097c682. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:25:54 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff" returned: 0 in 0.517s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:55 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:55 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-bf6068e8-0656-4feb-9821-c60d722175cb req-120abe4e-a799-4b7f-859b-f4d3158ca432 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-bf6068e8-0656-4feb-9821-c60d722175cb req-120abe4e-a799-4b7f-859b-f4d3158ca432 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-bf6068e8-0656-4feb-9821-c60d722175cb req-120abe4e-a799-4b7f-859b-f4d3158ca432 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-bf6068e8-0656-4feb-9821-c60d722175cb req-120abe4e-a799-4b7f-859b-f4d3158ca432 tempest-ServerActionsTestOtherA-1119472718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-4042317b-2e07-455d-afb0-1bb55308515d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3036e74f-e9d1-4cb2-ac24-8834b06ebb14', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-bf6068e8-0656-4feb-9821-c60d722175cb req-120abe4e-a799-4b7f-859b-f4d3158ca432 tempest-ServerActionsTestOtherA-1119472718 None] attachment_update completed successfully. Nov 05 08:25:55 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.541s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:55 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708 Nov 05 08:25:55 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:55 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff.83eb21bd-cb51-448d-a961-7b32275de708" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-83eb21bd-cb51-448d-a961-7b32275de708" released by "_delete_snapshot" :: held 2.240s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_snapshot" :: held 2.287s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Created reservations ['205f2eab-8a93-41e0-a857-17121fcfbf94', '0737e723-b733-4af7-bad7-d7f21b4d9548', 'c2627842-8e9d-4404-b767-f1a4d8d473a9', '1e7b0ae9-1fd8-49f1-ba68-ccedf62eb7a4'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Delete snapshot completed successfully. Nov 05 08:25:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7ec3ba56-7d96-41b5-83fe-b258666029ef tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-83eb21bd-cb51-448d-a961-7b32275de708-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-07a03e1b-e312-4798-bbb5-18a692a0c632 req-eb13edb7-7e10-4e20-80ac-67558536362b tempest-AttachVolumeTestJSON-1774921419 None] Terminate volume connection completed successfully. Nov 05 08:25:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-07a03e1b-e312-4798-bbb5-18a692a0c632 req-eb13edb7-7e10-4e20-80ac-67558536362b tempest-AttachVolumeTestJSON-1774921419 None] Deleting attachment 73ace2bf-9836-4deb-9fad-88ed21d53fa3. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "cinder-622b88b8-99d8-46b5-bfbf-203a0d2066ff-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-622b88b8-99d8-46b5-bfbf-203a0d2066ff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dfa532-ccb7-4bb5-a5d0-7c18bf482888]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:57 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff Nov 05 08:25:57 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:57 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff" returned: 0 in 0.428s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:57 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff Nov 05 08:25:57 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:58 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-622b88b8-99d8-46b5-bfbf-203a0d2066ff" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-quobyte-622b88b8-99d8-46b5-bfbf-203a0d2066ff" released by "delete_volume" :: held 0.934s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Created reservations ['04046020-5e25-45a6-b229-fa8a3925e5bc', 'a249f54d-4041-4142-a677-aed30ce4a80e', '0a506835-d7aa-4f21-859a-795d95dced0c', '55699511-4864-4020-9c9f-d9ef6b152992'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:58 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:25:58 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:58 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Deleted volume successfully. Nov 05 08:25:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-58a76116-a9be-402e-aae8-e0647af7fdb8 tempest-SnapshotsActionsTest-1762879222 None] Lock "cinder-622b88b8-99d8-46b5-bfbf-203a0d2066ff-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-03c6d75b-8dfe-4208-b7d2-a20c98101370-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-03c6d75b-8dfe-4208-b7d2-a20c98101370-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-quobyte-03c6d75b-8dfe-4208-b7d2-a20c98101370" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-03c6d75b-8dfe-4208-b7d2-a20c98101370" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0caf076-7d2d-465b-8834-06ca1432dad2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:06 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 Nov 05 08:26:06 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:06 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370" returned: 0 in 0.459s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:06 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370 Nov 05 08:26:06 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:06 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6d75b-8dfe-4208-b7d2-a20c98101370" returned: 0 in 0.272s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-03c6d75b-8dfe-4208-b7d2-a20c98101370" released by "delete_volume" :: held 0.813s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Created reservations ['1f7fe72c-72a0-4468-b9ed-14952f8840de', '95f5494f-cfee-48f9-83f2-90becee9b693', 'a0ff5930-32e7-44ff-9a1e-1585fa024068', '87a4fb4a-fad7-4ac6-90e0-584d943be10a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:07 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:07 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-quobyte-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:07 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Deleted volume successfully. Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d166718-8412-446c-9be0-55925dee4d13]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38045da6-e308-4406-a6c3-56834a46925d tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-03c6d75b-8dfe-4208-b7d2-a20c98101370-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:07 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc Nov 05 08:26:07 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:08 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" returned: 0 in 0.568s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:08 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc Nov 05 08:26:08 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:08 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" returned: 0 in 0.302s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc" released by "delete_volume" :: held 0.960s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Created reservations ['ceaa480c-3962-4ad8-acd9-fe2638fcbb63', 'd629c58d-d1d7-4233-81ff-2c61972f326c', 'c603a5be-242d-4de8-baa1-f056524b1938', 'fed60c7c-c961-4d7b-9b5c-3c807f7d090d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:08 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:08 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:08 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Deleted volume successfully. Nov 05 08:26:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c63a5e20-28c0-400c-9968-cd0bc5126569 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-4dc8ebb8-ffd2-41ca-91d3-d0bc9733d1fc-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-ee6a9ae5-38e3-4c2b-b54d-665a7f085339-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-ee6a9ae5-38e3-4c2b-b54d-665a7f085339-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "cinder-quobyte-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b341fde7-1fdb-431e-8431-1e2a316d015c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:10 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 Nov 05 08:26:10 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Flow 'volume_create_manager' (a68a6071-9e69-46e5-ad95-4e28045f299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b952c22a-483b-42a5-831b-3929f241b7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b952c22a-483b-42a5-831b-3929f241b7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1860261202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbd1fa3-3774-46c9-b6f5-180878226e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7005f7e797f040e3860a63d3c98253e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:10Z,use_quota=True,user_id='629a555b5d1f431992944d2d0229294a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8907ad66-f4aa-4ad6-86e4-2c2e2a17ad03),volume_type_id=8907ad66-f4aa-4ad6-86e4-2c2e2a17ad03)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6866e58f-ef6f-4b83-978b-5dcdd015d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6866e58f-ef6f-4b83-978b-5dcdd015d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecaf55a-9d81-4f86-a1d2-0719e21c1f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecaf55a-9d81-4f86-a1d2-0719e21c1f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbd1fa3-3774-46c9-b6f5-180878226e91', 'volume_name': 'volume-7fbd1fa3-3774-46c9-b6f5-180878226e91', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33be915-2148-49df-aece-bcf4cc2e2c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33be915-2148-49df-aece-bcf4cc2e2c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ee4a74-b35e-4647-ac47-86b1ab16fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Volume 7fbd1fa3-3774-46c9-b6f5-180878226e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbd1fa3-3774-46c9-b6f5-180878226e91', 'volume_size': 1} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1860261202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbd1fa3-3774-46c9-b6f5-180878226e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7005f7e797f040e3860a63d3c98253e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:10Z,use_quota=True,user_id='629a555b5d1f431992944d2d0229294a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8907ad66-f4aa-4ad6-86e4-2c2e2a17ad03),volume_type_id=8907ad66-f4aa-4ad6-86e4-2c2e2a17ad03)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Creating volume 7fbd1fa3-3774-46c9-b6f5-180878226e91 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:10 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:10 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 1073741824 Nov 05 08:26:10 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:10 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" returned: 0 in 0.525s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:10 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339 Nov 05 08:26:10 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" returned: 0 in 0.331s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:10 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-quobyte-ee6a9ae5-38e3-4c2b-b54d-665a7f085339" released by "delete_volume" :: held 0.921s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:10 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 1073741824" returned: 0 in 0.516s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Created reservations ['3e5596d2-6d29-4560-a2a4-7bd203369a56', '61ea9d9e-60ad-425c-85e5-f293a6044ea4', '9b2934d0-9cc6-4769-b8ae-cad5bad7f95c', '32daa593-075f-41de-ace5-474a0074153b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:11 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 Nov 05 08:26:11 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:11 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:11 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:11 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91" returned: 0 in 0.375s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ee4a74-b35e-4647-ac47-86b1ab16fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbd1fa3-3774-46c9-b6f5-180878226e91', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074288ed-fa53-4c05-888f-857e79221ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Volume volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 (7fbd1fa3-3774-46c9-b6f5-180878226e91): created successfully Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074288ed-fa53-4c05-888f-857e79221ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Flow 'volume_create_manager' (a68a6071-9e69-46e5-ad95-4e28045f299d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:11 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-988a2a2d-23a4-4e4b-b382-655cf78044d1 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Created volume successfully. Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.332s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Deleted volume successfully. Nov 05 08:26:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-82d4e3e8-2c16-46c7-ac1f-05b17f4c80d7 tempest-AttachVolumeTestJSON-1774921419 None] Lock "cinder-ee6a9ae5-38e3-4c2b-b54d-665a7f085339-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:12 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:12 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:13 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:13 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-634cb6fe-c90b-402c-96be-6593ead87629 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Retype volume completed successfully. Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "cinder-7fbd1fa3-3774-46c9-b6f5-180878226e91-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "cinder-7fbd1fa3-3774-46c9-b6f5-180878226e91-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "cinder-quobyte-7fbd1fa3-3774-46c9-b6f5-180878226e91" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "cinder-quobyte-7fbd1fa3-3774-46c9-b6f5-180878226e91" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b03169-800d-4a95-b5f3-993f4a53d009]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:14 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 Nov 05 08:26:14 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:15 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91" returned: 0 in 0.533s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:15 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91 Nov 05 08:26:15 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:15 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7fbd1fa3-3774-46c9-b6f5-180878226e91" returned: 0 in 0.310s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "cinder-quobyte-7fbd1fa3-3774-46c9-b6f5-180878226e91" released by "delete_volume" :: held 0.907s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:15 devstack cinder-volume[87101]: WARNING cinder.quota [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:26:15 devstack cinder-volume[87101]: WARNING cinder.quota [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Created reservations ['03d6d36c-121c-4281-8d1f-3bad5fe2a553', '64f29cd9-182b-4afa-88e7-6667976bec56', 'c5d92767-7012-43e1-8de3-f20552f9f9cc', '1611d396-e156-478d-b9ff-981f0417d61a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:15 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:15 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:16 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.394s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:16 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Deleted volume successfully. Nov 05 08:26:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-84d01578-1520-4e6f-9133-8ebdfe4ad747 tempest-VolumeRetypeWithoutMigrationTest-287709745 None] Lock "cinder-7fbd1fa3-3774-46c9-b6f5-180878226e91-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Flow 'volume_create_manager' (dfc96134-af7d-49ee-89f1-814a4bb14410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603d352-8b1b-40a4-9b7e-1fe81b2fb143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603d352-8b1b-40a4-9b7e-1fe81b2fb143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1234140417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea73e8e-e0ff-4029-ae97-9055fb8f6eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f299f92cba6f4c5f84b89faa67fab846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:24Z,use_quota=True,user_id='a07e6ae66efd4d34b0a3f73a48b25f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc83504-d47c-40f1-9523-6feeb52464c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc83504-d47c-40f1-9523-6feeb52464c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edc943b-8f59-471e-9e87-62565201048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edc943b-8f59-471e-9e87-62565201048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea73e8e-e0ff-4029-ae97-9055fb8f6eae', 'volume_name': 'volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5873722e-f95d-44dd-b7b0-d8513a2f9905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5873722e-f95d-44dd-b7b0-d8513a2f9905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311cee47-3f00-4f01-8f27-28db13fd5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Volume aea73e8e-e0ff-4029-ae97-9055fb8f6eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae', 'volume_size': 1} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1234140417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea73e8e-e0ff-4029-ae97-9055fb8f6eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f299f92cba6f4c5f84b89faa67fab846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:24Z,use_quota=True,user_id='a07e6ae66efd4d34b0a3f73a48b25f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Creating volume aea73e8e-e0ff-4029-ae97-9055fb8f6eae {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:24 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:24 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae 1073741824 Nov 05 08:26:24 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Flow 'volume_create_manager' (946bd731-e13b-4845-88ed-1c4393ace9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499ad849-b271-49a0-a08b-48f88ca1285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499ad849-b271-49a0-a08b-48f88ca1285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1484797052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d4f2f4-777a-4bf1-94ee-47c34bdbe35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ea6467feb144339063f2b4d37d2889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:25Z,use_quota=True,user_id='ece4a9618f4144c3b458e2bcc537d595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fd51ab-b90a-4474-ad3f-44ea3ff568d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fd51ab-b90a-4474-ad3f-44ea3ff568d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee89178-2b17-4350-b96d-9d842c19276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee89178-2b17-4350-b96d-9d842c19276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d4f2f4-777a-4bf1-94ee-47c34bdbe35f', 'volume_name': 'volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b17f49-109c-4f32-bd06-ee55c0f0c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b17f49-109c-4f32-bd06-ee55c0f0c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf33e16-0fb4-463b-8537-587afbd76009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:24 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Volume 02d4f2f4-777a-4bf1-94ee-47c34bdbe35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f', 'volume_size': 1} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:24 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae 1073741824" returned: 0 in 0.613s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:24 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae Nov 05 08:26:24 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:25 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1484797052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d4f2f4-777a-4bf1-94ee-47c34bdbe35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ea6467feb144339063f2b4d37d2889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:25Z,use_quota=True,user_id='ece4a9618f4144c3b458e2bcc537d595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Creating volume 02d4f2f4-777a-4bf1-94ee-47c34bdbe35f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:25 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311cee47-3f00-4f01-8f27-28db13fd5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f7d0e7-0acf-4b84-ab5e-ec633e9020ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:25 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f 1073741824 Nov 05 08:26:25 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Volume volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae (aea73e8e-e0ff-4029-ae97-9055fb8f6eae): created successfully Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f7d0e7-0acf-4b84-ab5e-ec633e9020ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Flow 'volume_create_manager' (dfc96134-af7d-49ee-89f1-814a4bb14410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:25 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-12339731-38c7-4b5b-a38e-f8a274cbcd2d tempest-VolumesMetadataTest-163727353 None] Created volume successfully. Nov 05 08:26:25 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f 1073741824" returned: 0 in 0.484s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:25 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f Nov 05 08:26:25 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:25 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf33e16-0fb4-463b-8537-587afbd76009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43bf98-e96e-4b5b-93b3-8453c11a6625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Volume volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f (02d4f2f4-777a-4bf1-94ee-47c34bdbe35f): created successfully Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43bf98-e96e-4b5b-93b3-8453c11a6625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Flow 'volume_create_manager' (946bd731-e13b-4845-88ed-1c4393ace9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8339f9cf-3ef5-4188-9ac9-4e1a55a7a7e5 tempest-VolumesServicesTestJSON-1929935774 None] Created volume successfully. Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Acquiring lock "cinder-aea73e8e-e0ff-4029-ae97-9055fb8f6eae-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Acquiring lock "cinder-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "cinder-aea73e8e-e0ff-4029-ae97-9055fb8f6eae-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "cinder-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Acquiring lock "cinder-quobyte-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Acquiring lock "cinder-quobyte-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "cinder-quobyte-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "cinder-quobyte-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" acquired by "delete_volume" :: waited 0.070s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f911effe-b976-4b47-be64-ae793d72781a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291b4a4-09f2-43e5-86f2-91a6d060fa61]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:27 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae Nov 05 08:26:27 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:27 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f Nov 05 08:26:27 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" returned: 0 in 0.511s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:28 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f Nov 05 08:26:28 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" returned: 0 in 0.685s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:28 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae Nov 05 08:26:28 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" returned: 0 in 0.455s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "cinder-quobyte-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f" released by "delete_volume" :: held 1.046s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=123,cinder:UPDATE=89,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:28 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=118,cinder:DELETE=10,cinder:INSERT=33,cinder:UPDATE=118 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "cinder-quobyte-aea73e8e-e0ff-4029-ae97-9055fb8f6eae" released by "delete_volume" :: held 1.172s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Created reservations ['cc6f4cd3-f07e-4211-8be7-5a9cbe0581d6', '85314442-1d45-4518-8330-9cab01b712e9', '0bc4d254-cee1-4e49-a633-f12d4483dc26', '7afef537-a946-43ed-867e-f8ea0b34ea68'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:28 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Created reservations ['e8871bd7-c908-41c1-a29e-c2ced95e0c0e', 'b32011d2-f60f-4187-91e3-b66ccb5affdf', '9d1ecd99-f7f7-4535-af1f-25b652c5dc04', '7acae53a-d6ce-4b28-96a9-af1b614817a1'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:29 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:29 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:29 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:29 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:29 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.395s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Deleted volume successfully. Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d00a5fdb-cd64-4945-9b43-bf3679c5e2e3 tempest-VolumesServicesTestJSON-1929935774 None] Lock "cinder-02d4f2f4-777a-4bf1-94ee-47c34bdbe35f-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:29 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Deleted volume successfully. Nov 05 08:26:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9496d2cd-f532-40e3-bba2-2eb33fd0f28a tempest-VolumesMetadataTest-163727353 None] Lock "cinder-aea73e8e-e0ff-4029-ae97-9055fb8f6eae-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-3b31bfd2-d740-4a1d-a9bb-b3774d8f52aa tempest-ServerActionsTestOtherA-1119472718 None] Terminate volume connection completed successfully. Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-3b31bfd2-d740-4a1d-a9bb-b3774d8f52aa tempest-ServerActionsTestOtherA-1119472718 None] Deleting attachment 3036e74f-e9d1-4cb2-ac24-8834b06ebb14. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "cinder-4042317b-2e07-455d-afb0-1bb55308515d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-4042317b-2e07-455d-afb0-1bb55308515d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "cinder-quobyte-4042317b-2e07-455d-afb0-1bb55308515d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-quobyte-4042317b-2e07-455d-afb0-1bb55308515d" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1405962-44ab-4332-99df-7c50831419a2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:33 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d Nov 05 08:26:33 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:34 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d" returned: 0 in 0.583s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:34 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d Nov 05 08:26:34 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:34 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4042317b-2e07-455d-afb0-1bb55308515d" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-quobyte-4042317b-2e07-455d-afb0-1bb55308515d" released by "delete_volume" :: held 1.066s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG cinder.quota [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Created reservations ['9e8825f9-fb40-432c-9e01-62a2b952f661', 'ca0a77d8-ebad-417f-a28e-e45701d7acb8', '87baf489-b336-4cd1-80d0-11d1a005f244', 'fa94355c-a2e2-4fdf-a656-871ac17620ba'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:34 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:34 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:35 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.296s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.manager [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Deleted volume successfully. Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-2fe30900-71a2-4690-ade7-9cbbddd5f3ca req-e9e5cf3d-6fc2-43b4-9ded-5e51c0ab45cb tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-4042317b-2e07-455d-afb0-1bb55308515d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "cinder-da7ecd49-f196-442b-841a-64c7f445f1c4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-da7ecd49-f196-442b-841a-64c7f445f1c4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "cinder-quobyte-da7ecd49-f196-442b-841a-64c7f445f1c4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-quobyte-da7ecd49-f196-442b-841a-64c7f445f1c4" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb309f5-0f05-4b5e-ae9c-255a08958ea0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:35 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 Nov 05 08:26:35 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:35 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4" returned: 0 in 0.450s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:35 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4 Nov 05 08:26:35 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:36 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-da7ecd49-f196-442b-841a-64c7f445f1c4" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-quobyte-da7ecd49-f196-442b-841a-64c7f445f1c4" released by "delete_volume" :: held 0.843s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Created reservations ['eb906f6f-a7e1-4a36-ae2a-12d1ceb8a4df', '762a10de-235d-4adc-b1c4-cbec21125336', 'e06c0d04-7726-4fdf-9333-f3c9cae86660', '9827d6c7-5063-434b-8db2-61ca9100044d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:36 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:36 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:36 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.330s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Deleted volume successfully. Nov 05 08:26:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9ff70b12-6329-4602-9423-b44b557ce867 tempest-ServerActionsTestOtherA-1119472718 None] Lock "cinder-da7ecd49-f196-442b-841a-64c7f445f1c4-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Flow 'volume_create_manager' (fc5b79c9-9dec-43cd-b8ca-019dc2ed3c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2862443-69cb-4a29-97f5-030955d24b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2862443-69cb-4a29-97f5-030955d24b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-428475428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26c70a4-2302-40da-87fe-9d5980222ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c58c28ace2540429288e9e43857b2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:37Z,use_quota=True,user_id='129b0c705d324189ae80c38d6ec9031f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a58a00-6415-4668-bdcc-ca6fcc0b71d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a58a00-6415-4668-bdcc-ca6fcc0b71d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1231853-5a11-4ff6-a2e9-b08058c0d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1231853-5a11-4ff6-a2e9-b08058c0d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26c70a4-2302-40da-87fe-9d5980222ca8', 'volume_name': 'volume-d26c70a4-2302-40da-87fe-9d5980222ca8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c064630a-9941-40eb-bdc8-db553c49f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c064630a-9941-40eb-bdc8-db553c49f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e57deb-cdbb-4d5c-bf1c-5c5c7e381648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Volume d26c70a4-2302-40da-87fe-9d5980222ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26c70a4-2302-40da-87fe-9d5980222ca8', 'volume_size': 1} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-428475428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26c70a4-2302-40da-87fe-9d5980222ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c58c28ace2540429288e9e43857b2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:37Z,use_quota=True,user_id='129b0c705d324189ae80c38d6ec9031f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Creating volume d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:37 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:26:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:37 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 1073741824 Nov 05 08:26:37 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:38 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 1073741824" returned: 0 in 0.811s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:38 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:26:38 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:38 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e57deb-cdbb-4d5c-bf1c-5c5c7e381648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26c70a4-2302-40da-87fe-9d5980222ca8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90afdb1-a9f4-4076-a108-d61387e68021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:38 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Volume volume-d26c70a4-2302-40da-87fe-9d5980222ca8 (d26c70a4-2302-40da-87fe-9d5980222ca8): created successfully Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90afdb1-a9f4-4076-a108-d61387e68021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Flow 'volume_create_manager' (fc5b79c9-9dec-43cd-b8ca-019dc2ed3c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-36431fce-c7af-4429-8a7b-bf1c5b5dcc44 tempest-VolumesCloneTest-1527617286 None] Created volume successfully. Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Flow 'volume_create_manager' (b7866960-c147-42d2-a941-004dc530f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4549357e-a889-46ce-bc6b-2ebfff1a5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4549357e-a889-46ce-bc6b-2ebfff1a5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1695111765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c203bf-03e2-48d0-8609-5d81e1147ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c58c28ace2540429288e9e43857b2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d26c70a4-2302-40da-87fe-9d5980222ca8,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:40Z,use_quota=True,user_id='129b0c705d324189ae80c38d6ec9031f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548f585c-6191-49ba-9cb0-7ac299841f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548f585c-6191-49ba-9cb0-7ac299841f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb26aed-d6df-445d-b88d-b0c765c95de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb26aed-d6df-445d-b88d-b0c765c95de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e5c203bf-03e2-48d0-8609-5d81e1147ee2', 'volume_name': 'volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2', 'volume_size': 2, 'source_volid': 'd26c70a4-2302-40da-87fe-9d5980222ca8', 'source_volstatus': 'available'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68030269-5a48-4b7c-be62-24c019f038ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68030269-5a48-4b7c-be62-24c019f038ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053644d-a25b-4ff5-8394-63579aabb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Volume e5c203bf-03e2-48d0-8609-5d81e1147ee2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2', 'volume_size': 2, 'source_volid': 'd26c70a4-2302-40da-87fe-9d5980222ca8', 'source_volstatus': 'available'} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:40 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Cloning volume d26c70a4-2302-40da-87fe-9d5980222ca8 to volume e5c203bf-03e2-48d0-8609-5d81e1147ee2 Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Creating offline snapshot 9f93f29d-31c5-462f-99c0-c08d89af3eb9 of volume d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f1ce16-00bf-4720-a841-ccb835accdb9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:40 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:26:40 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:41 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.593s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:41 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 1G Nov 05 08:26:41 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:41 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 1G" returned: 0 in 0.617s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26c70a4-2302-40da-87fe-9d5980222ca8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:41 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26c70a4-2302-40da-87fe-9d5980222ca8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:41 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:42 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26c70a4-2302-40da-87fe-9d5980222ca8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.405s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:42 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 is being set with open permissions: ugo+rw Nov 05 08:26:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:42 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:42 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:42 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:42 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info Nov 05 08:26:42 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:43 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:43 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info is being set with open permissions: ugo+rw Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:43 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info Nov 05 08:26:43 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:43 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.info" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] snapshot: 9f93f29d-31c5-462f-99c0-c08d89af3eb9, volume: e5c203bf-03e2-48d0-8609-5d81e1147ee2, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d087c79-e59b-4102-925b-fc4f4377a57e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:43 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:43 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:44 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.742s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d26c70a4-2302-40da-87fe-9d5980222ca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265e530-07e6-4bfa-a3ef-573f2f124c2a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:44 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:26:44 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:44 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.744s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:26:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:45 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 Nov 05 08:26:45 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:48 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:26:48 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:49 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.756s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:26:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:26:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:26:52 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:52 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=26,cinder:INSERT=11,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:56 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2" returned: 0 in 11.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8, size 1024.00 MB, duration 11.52 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:26:56 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Converted 1024.00 MB image at 88.85 MB/s Nov 05 08:26:56 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 is being set with open permissions: ugo+rw Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:56 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 Nov 05 08:26:56 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:56 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" released by "_copy_volume_from_snapshot" :: held 13.572s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-quobyte-9f93f29d-31c5-462f-99c0-c08d89af3eb9" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-9f93f29d-31c5-462f-99c0-c08d89af3eb9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Deleting offline snapshot 9f93f29d-31c5-462f-99c0-c08d89af3eb9 of volume d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] snapshot_file for this snap is: volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[28369a0e-906b-4207-a516-3aa152628d3d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:57 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:57 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:57 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.457s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d26c70a4-2302-40da-87fe-9d5980222ca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e505d-8777-47f5-8e14-c39d1403ea39]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:57 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:26:57 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:58 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.635s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:58 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:58 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:58 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:58 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9 Nov 05 08:26:58 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:59 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8.9f93f29d-31c5-462f-99c0-c08d89af3eb9" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-9f93f29d-31c5-462f-99c0-c08d89af3eb9" released by "_delete_snapshot" :: held 2.120s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.595s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053644d-a25b-4ff5-8394-63579aabb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2', 'volume_size': 2, 'source_volid': 'd26c70a4-2302-40da-87fe-9d5980222ca8', 'source_volstatus': 'available'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b896b0-b408-4f88-b0d9-aaf7fe1acb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Volume volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 (e5c203bf-03e2-48d0-8609-5d81e1147ee2): created successfully Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b896b0-b408-4f88-b0d9-aaf7fe1acb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Flow 'volume_create_manager' (b7866960-c147-42d2-a941-004dc530f407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-97665343-6164-4495-9f59-a9725845f117 tempest-VolumesCloneTest-1527617286 None] Created volume successfully. Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-e5c203bf-03e2-48d0-8609-5d81e1147ee2-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-e5c203bf-03e2-48d0-8609-5d81e1147ee2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89bd584-5efd-4644-8a68-ad9512f510e4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:00 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 Nov 05 08:27:00 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:01 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2" returned: 0 in 0.431s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:01 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2 Nov 05 08:27:01 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:01 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e5c203bf-03e2-48d0-8609-5d81e1147ee2" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-e5c203bf-03e2-48d0-8609-5d81e1147ee2" released by "delete_volume" :: held 0.801s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Created reservations ['d4bed64c-a224-4e6d-b1a5-5b4cdd93bef5', 'c1b7b0c2-f336-4e19-9782-648babbf7b9d', 'b7f206a4-c6e2-428b-ae9d-2612b986fb2f', 'd012fd6f-87ab-48ff-a56e-f54e340cea37'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:01 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:01 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:01 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-d26c70a4-2302-40da-87fe-9d5980222ca8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Deleted volume successfully. Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-d26c70a4-2302-40da-87fe-9d5980222ca8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ef169312-e80c-4593-87ec-94f667c57444 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-e5c203bf-03e2-48d0-8609-5d81e1147ee2-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "cinder-quobyte-d26c70a4-2302-40da-87fe-9d5980222ca8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-d26c70a4-2302-40da-87fe-9d5980222ca8" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5625e-0920-4c49-8750-906425d7b117]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:02 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:27:02 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:02 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.443s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:02 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8 Nov 05 08:27:02 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:02 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d26c70a4-2302-40da-87fe-9d5980222ca8" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-quobyte-d26c70a4-2302-40da-87fe-9d5980222ca8" released by "delete_volume" :: held 0.831s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Created reservations ['b362ff35-d789-446b-a19d-57ca2f700167', 'aa7bbcd4-c751-440e-ba68-9f42b8b95aac', '5242ec6c-9f6b-4672-9c40-250e6a429db1', 'd4b6c8b1-f0f9-4835-9ea0-9c286d6257f7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:02 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:02 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:03 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.317s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:03 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Deleted volume successfully. Nov 05 08:27:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b4a3ced8-442e-4856-8620-6f54a01fd1f2 tempest-VolumesCloneTest-1527617286 None] Lock "cinder-d26c70a4-2302-40da-87fe-9d5980222ca8-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (ea3f478f-0486-4ec6-bd84-bd52e5240540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269fa1ef-0f83-469a-bc59-fb105860f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269fa1ef-0f83-469a-bc59-fb105860f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1060396413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d6a725-08c5-476e-bacc-e58d0d799d5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62332d1c-7550-4663-a2b2-6195476e7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62332d1c-7550-4663-a2b2-6195476e7da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99256e4f-eb33-42dc-93c4-91b42648243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99256e4f-eb33-42dc-93c4-91b42648243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d6a725-08c5-476e-bacc-e58d0d799d5a', 'volume_name': 'volume-83d6a725-08c5-476e-bacc-e58d0d799d5a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6b91d-1397-4905-b746-7fbbc041bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6b91d-1397-4905-b746-7fbbc041bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c6ece3-0166-4319-8357-0c6ae0254e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Volume 83d6a725-08c5-476e-bacc-e58d0d799d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d6a725-08c5-476e-bacc-e58d0d799d5a', 'volume_size': 1} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1060396413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d6a725-08c5-476e-bacc-e58d0d799d5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Creating volume 83d6a725-08c5-476e-bacc-e58d0d799d5a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:13 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:13 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a 1073741824 Nov 05 08:27:13 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (5df1cd0d-39d0-48a2-a1f1-b15805350dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a271d5-6d18-41d1-8d93-ae05d29adf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a271d5-6d18-41d1-8d93-ae05d29adf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1620911986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee89f44-4a17-4563-ae3a-bb7aa15342f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76bbc34-3dba-4231-b14d-e9d586d1f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76bbc34-3dba-4231-b14d-e9d586d1f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2185675b-a1b7-4a02-8b70-1a4f21e3ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2185675b-a1b7-4a02-8b70-1a4f21e3ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee89f44-4a17-4563-ae3a-bb7aa15342f8', 'volume_name': 'volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4e31d-0800-4336-84a7-aa1863df03c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4e31d-0800-4336-84a7-aa1863df03c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bf8c34-fe8a-475c-a669-d8034f16879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Volume dee89f44-4a17-4563-ae3a-bb7aa15342f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8', 'volume_size': 1} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:13 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a 1073741824" returned: 0 in 0.616s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:13 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a Nov 05 08:27:13 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:14 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1620911986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee89f44-4a17-4563-ae3a-bb7aa15342f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Creating volume dee89f44-4a17-4563-ae3a-bb7aa15342f8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:14 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c6ece3-0166-4319-8357-0c6ae0254e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d6a725-08c5-476e-bacc-e58d0d799d5a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 1073741824 Nov 05 08:27:14 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2276a2-49ae-4f59-9e99-228211f32fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Volume volume-83d6a725-08c5-476e-bacc-e58d0d799d5a (83d6a725-08c5-476e-bacc-e58d0d799d5a): created successfully Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2276a2-49ae-4f59-9e99-228211f32fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (ea3f478f-0486-4ec6-bd84-bd52e5240540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-53d743cb-e434-4d7c-9734-e4986a236711 tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:27:14 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 1073741824" returned: 0 in 0.624s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:14 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 Nov 05 08:27:14 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:15 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bf8c34-fe8a-475c-a669-d8034f16879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a379f9e-c948-4277-8e00-a5d8edc142bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Volume volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 (dee89f44-4a17-4563-ae3a-bb7aa15342f8): created successfully Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a379f9e-c948-4277-8e00-a5d8edc142bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (5df1cd0d-39d0-48a2-a1f1-b15805350dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-71790400-f83f-4ee3-ba7d-75c1e4b61274 tempest-AttachVolumeNegativeTest-1576733215 None] Created volume successfully. Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (5b913e4b-e58b-4754-a48b-4e170cc970e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c37235-2ef8-4be2-82fd-591e341e42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c37235-2ef8-4be2-82fd-591e341e42db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-330918805',display_name='tempest-VolumesGetTest-Volume-679700997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edc650a-b078-48fb-a183-b5b63757b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:16Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b336133d-e0b1-46ef-8e79-f1ace12af347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b336133d-e0b1-46ef-8e79-f1ace12af347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439c4e8d-0aa0-47ff-b197-a68d6f4e2ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439c4e8d-0aa0-47ff-b197-a68d6f4e2ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edc650a-b078-48fb-a183-b5b63757b4e3', 'volume_name': 'volume-6edc650a-b078-48fb-a183-b5b63757b4e3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8373a452-abeb-4ccd-802a-ccbe48f655f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8373a452-abeb-4ccd-802a-ccbe48f655f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42a9a71-9641-4fae-b7ab-1b0a2f2248f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Volume 6edc650a-b078-48fb-a183-b5b63757b4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edc650a-b078-48fb-a183-b5b63757b4e3', 'volume_size': 1} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-330918805',display_name='tempest-VolumesGetTest-Volume-679700997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edc650a-b078-48fb-a183-b5b63757b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:16Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Creating volume 6edc650a-b078-48fb-a183-b5b63757b4e3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:16 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:16 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 1073741824 Nov 05 08:27:16 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c3a02200-c21b-49f5-93eb-154f8c007240 req-2c6fe489-bbce-4b96-ab53-618917fc6142 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:17 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 1073741824" returned: 0 in 0.757s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:17 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 Nov 05 08:27:17 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:17 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c3a02200-c21b-49f5-93eb-154f8c007240 req-2c6fe489-bbce-4b96-ab53-618917fc6142 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.048s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-c3a02200-c21b-49f5-93eb-154f8c007240 req-2c6fe489-bbce-4b96-ab53-618917fc6142 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42a9a71-9641-4fae-b7ab-1b0a2f2248f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edc650a-b078-48fb-a183-b5b63757b4e3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a477ea25-3c02-47f0-8bc3-07a35d6697fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Volume volume-6edc650a-b078-48fb-a183-b5b63757b4e3 (6edc650a-b078-48fb-a183-b5b63757b4e3): created successfully Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a477ea25-3c02-47f0-8bc3-07a35d6697fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (5b913e4b-e58b-4754-a48b-4e170cc970e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-c3a02200-c21b-49f5-93eb-154f8c007240 req-2c6fe489-bbce-4b96-ab53-618917fc6142 tempest-AttachVolumeNegativeTest-1576733215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef3570be-9a82-4f1b-9d54-827d3ac78229', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:27:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d280ea13-5ee3-43dc-af72-d22a59345c5b tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:27:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-c3a02200-c21b-49f5-93eb-154f8c007240 req-2c6fe489-bbce-4b96-ab53-618917fc6142 tempest-AttachVolumeNegativeTest-1576733215 None] attachment_update completed successfully. Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-6edc650a-b078-48fb-a183-b5b63757b4e3-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "cinder-6edc650a-b078-48fb-a183-b5b63757b4e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-6edc650a-b078-48fb-a183-b5b63757b4e3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-6edc650a-b078-48fb-a183-b5b63757b4e3" acquired by "delete_volume" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d83e8-41f4-48e9-be38-b33800255d1b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:18 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 Nov 05 08:27:18 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:19 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3" returned: 0 in 0.755s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:19 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3 Nov 05 08:27:19 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:19 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6edc650a-b078-48fb-a183-b5b63757b4e3" returned: 0 in 0.386s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-6edc650a-b078-48fb-a183-b5b63757b4e3" released by "delete_volume" :: held 1.281s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Created reservations ['1659b09f-ed03-4ff4-9428-1737414aeaf1', '2e88c67d-d931-4406-b309-9079efddfd6c', '9b6a233b-22cb-42b9-8fa5-5c31f73aa301', 'ca95af5d-8b31-4376-ad94-8f949e0533da'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:20 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:20 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:20 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bd202397-1b05-4ed4-90c9-3b0fe5643457 tempest-VolumesGetTest-543604025 None] Lock "cinder-6edc650a-b078-48fb-a183-b5b63757b4e3-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-83d6a725-08c5-476e-bacc-e58d0d799d5a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "cinder-83d6a725-08c5-476e-bacc-e58d0d799d5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-83d6a725-08c5-476e-bacc-e58d0d799d5a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-83d6a725-08c5-476e-bacc-e58d0d799d5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6be3d6-ed97-4dac-8750-2fd99eed2c49]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:21 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a Nov 05 08:27:21 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:21 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:21 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a Nov 05 08:27:21 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:21 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-83d6a725-08c5-476e-bacc-e58d0d799d5a" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-83d6a725-08c5-476e-bacc-e58d0d799d5a" released by "delete_volume" :: held 0.779s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Created reservations ['2b1b8cca-6a5c-4f7e-bacf-002346ee0a00', 'ddda9656-ac91-4287-a869-35d656222baf', '6fad4183-1e6f-4ecb-83ec-17650b7fe644', '8476115d-36b2-4553-9cf4-837e89c52cc7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:22 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:22 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:22 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.301s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd63aa3a-69a1-4b3c-9893-854d37760d05 tempest-VolumesGetTest-543604025 None] Lock "cinder-83d6a725-08c5-476e-bacc-e58d0d799d5a-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (1c06ba27-ef6e-479d-b2b5-55544f6c96fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d124fd-ebdf-41c5-a475-62e4f252d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d124fd-ebdf-41c5-a475-62e4f252d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-700856403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c9132f-6db4-4a18-88d7-958c11ddd0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:23Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027fba8-4db4-4865-9ec6-14278d265805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027fba8-4db4-4865-9ec6-14278d265805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28f220-6056-41cd-9866-9cd654e04707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28f220-6056-41cd-9866-9cd654e04707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'volume_name': 'volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c081a062-db6b-432f-ab71-a531fc0dac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c081a062-db6b-432f-ab71-a531fc0dac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4419080-e887-44e3-ac71-e55582b6ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:22 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Volume e1c9132f-6db4-4a18-88d7-958c11ddd0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'volume_size': 1} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-700856403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c9132f-6db4-4a18-88d7-958c11ddd0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:23Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Creating volume e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:22 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:22 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 1073741824 Nov 05 08:27:22 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:23 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 1073741824" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:23 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:23 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:23 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.384s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4419080-e887-44e3-ac71-e55582b6ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ac4ddd-0ee1-435b-bd88-66d7829608a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Volume volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 (e1c9132f-6db4-4a18-88d7-958c11ddd0b8): created successfully Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ac4ddd-0ee1-435b-bd88-66d7829608a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (1c06ba27-ef6e-479d-b2b5-55544f6c96fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-198f105c-b3d8-4bc8-843d-45d2af131665 tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:27:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (a8e833c9-dce6-4922-9be1-60d1e37b600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47180ad6-6b7e-4e46-8666-016a19ff6bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47180ad6-6b7e-4e46-8666-016a19ff6bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2028430367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f18e4a-1ff7-4b40-96d3-cbffb8242e4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e1c9132f-6db4-4a18-88d7-958c11ddd0b8,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:26Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed85bfb-a021-4cd6-aac4-3d13eab0284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed85bfb-a021-4cd6-aac4-3d13eab0284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6963cd40-185c-456c-8e74-e0624a020b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6963cd40-185c-456c-8e74-e0624a020b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '94f18e4a-1ff7-4b40-96d3-cbffb8242e4c', 'volume_name': 'volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c', 'volume_size': 1, 'source_volid': 'e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'source_volstatus': 'available'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e26a393-3b40-421b-b111-e74a9a0160cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e26a393-3b40-421b-b111-e74a9a0160cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2519df-da81-47b3-9ff3-8fe54c9e8da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Volume 94f18e4a-1ff7-4b40-96d3-cbffb8242e4c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c', 'volume_size': 1, 'source_volid': 'e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'source_volstatus': 'available'} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:26 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Cloning volume e1c9132f-6db4-4a18-88d7-958c11ddd0b8 to volume 94f18e4a-1ff7-4b40-96d3-cbffb8242e4c Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Creating offline snapshot 62599bd9-2e11-40c8-ba82-7dd2f9453c00 of volume e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5d24c-2948-4b93-98f7-1f2c76316c08]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:26 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:26 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:26 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.499s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:26 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 1G Nov 05 08:27:26 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:27 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 1G" returned: 0 in 1.108s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:28 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:28 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:28 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.814s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:28 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 is being set with open permissions: ugo+rw Nov 05 08:27:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:28 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:28 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:29 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.539s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:29 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info Nov 05 08:27:29 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:29 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info" returned: 0 in 0.646s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:29 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info is being set with open permissions: ugo+rw Nov 05 08:27:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:30 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info Nov 05 08:27:30 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:30 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.info" returned: 0 in 0.564s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] snapshot: 62599bd9-2e11-40c8-ba82-7dd2f9453c00, volume: 94f18e4a-1ff7-4b40-96d3-cbffb8242e4c, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f2882-b025-4afd-8725-8ddea1e630e6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:30 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:30 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:31 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.641s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:27:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0c672d-cdfd-444c-a87c-80ec2ad57de9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:31 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:31 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:32 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.879s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:27:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:27:32 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:27:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:32 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c Nov 05 08:27:32 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=46,cinder:SELECT=43,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:27:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=54,cinder:SELECT=36,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:27:44 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" returned: 0 in 12.129s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8, size 1024.00 MB, duration 12.13 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:27:44 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Converted 1024.00 MB image at 84.40 MB/s Nov 05 08:27:44 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c is being set with open permissions: ugo+rw Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:44 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c Nov 05 08:27:44 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:44 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" returned: 0 in 0.311s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" released by "_copy_volume_from_snapshot" :: held 14.117s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-62599bd9-2e11-40c8-ba82-7dd2f9453c00" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-62599bd9-2e11-40c8-ba82-7dd2f9453c00" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Deleting offline snapshot 62599bd9-2e11-40c8-ba82-7dd2f9453c00 of volume e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] snapshot_file for this snap is: volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee25e0a-a35e-4936-863b-2d6b73bcbeab]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:45 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:45 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:45 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.477s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:27:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa63862-96c0-45a5-83b8-02e6bfbb142b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:45 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:45 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:46 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.727s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:46 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:46 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:46 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.483s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:46 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00 Nov 05 08:27:46 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:46 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8.62599bd9-2e11-40c8-ba82-7dd2f9453c00" returned: 0 in 0.351s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-62599bd9-2e11-40c8-ba82-7dd2f9453c00" released by "_delete_snapshot" :: held 2.185s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.906s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2519df-da81-47b3-9ff3-8fe54c9e8da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c', 'volume_size': 1, 'source_volid': 'e1c9132f-6db4-4a18-88d7-958c11ddd0b8', 'source_volstatus': 'available'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2603df-c07a-44a4-8359-615349149ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Volume volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c (94f18e4a-1ff7-4b40-96d3-cbffb8242e4c): created successfully Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2603df-c07a-44a4-8359-615349149ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (a8e833c9-dce6-4922-9be1-60d1e37b600a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c4fa3f8f-2abc-4330-88ae-a08ab92c94f7 tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:48 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:48 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:49 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.586s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (b40e3722-9edf-4b85-ac16-12882d882b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a14ae88-8e19-4f1d-b16b-c1dcfabb3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a14ae88-8e19-4f1d-b16b-c1dcfabb3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390793986',display_name='tempest-VolumesGetTest-Volume-2039622857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7942343c-b8eb-497d-8be1-743b82e4ca1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:50Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df12c194-9c22-4087-9b6c-9ecf9186528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df12c194-9c22-4087-9b6c-9ecf9186528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0289b4-458e-4a25-952a-a654384d51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0289b4-458e-4a25-952a-a654384d51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7942343c-b8eb-497d-8be1-743b82e4ca1f', 'volume_name': 'volume-7942343c-b8eb-497d-8be1-743b82e4ca1f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22e41c5-68e3-4345-8c9d-6f3344160728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22e41c5-68e3-4345-8c9d-6f3344160728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c372f524-3dff-414b-8d2b-b2c29b8ddb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:49 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Volume 7942343c-b8eb-497d-8be1-743b82e4ca1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7942343c-b8eb-497d-8be1-743b82e4ca1f', 'volume_size': 1} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390793986',display_name='tempest-VolumesGetTest-Volume-2039622857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7942343c-b8eb-497d-8be1-743b82e4ca1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:50Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Creating volume 7942343c-b8eb-497d-8be1-743b82e4ca1f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:49 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:50 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f 1073741824 Nov 05 08:27:50 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Flow 'volume_create_manager' (55d9df36-cd78-430e-8469-47f70407b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8366593d-c5c1-4aad-b740-8689e1ee0d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8366593d-c5c1-4aad-b740-8689e1ee0d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-871600180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926ee27-4075-4d5e-ac1c-0d86f685549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5b7ebe24664cea84641165e06475de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:50Z,use_quota=True,user_id='54b1c9d1d0814cb2abecea06d133b063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f59e4b9-34f8-4dde-a90d-a7ff5b0f9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f59e4b9-34f8-4dde-a90d-a7ff5b0f9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c2d2b1-6bc1-4896-977c-080850474cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c2d2b1-6bc1-4896-977c-080850474cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3926ee27-4075-4d5e-ac1c-0d86f685549e', 'volume_name': 'volume-3926ee27-4075-4d5e-ac1c-0d86f685549e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afc8b8e-e975-4b1b-b397-e47a5e573a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afc8b8e-e975-4b1b-b397-e47a5e573a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abea547e-b981-4433-bdf0-c8aaaa7776d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Volume 3926ee27-4075-4d5e-ac1c-0d86f685549e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3926ee27-4075-4d5e-ac1c-0d86f685549e', 'volume_size': 1} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:50 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f 1073741824" returned: 0 in 0.958s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:51 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f Nov 05 08:27:51 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:51 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-871600180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926ee27-4075-4d5e-ac1c-0d86f685549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5b7ebe24664cea84641165e06475de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:50Z,use_quota=True,user_id='54b1c9d1d0814cb2abecea06d133b063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Creating volume 3926ee27-4075-4d5e-ac1c-0d86f685549e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:51 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c372f524-3dff-414b-8d2b-b2c29b8ddb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7942343c-b8eb-497d-8be1-743b82e4ca1f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:51 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e 1073741824 Nov 05 08:27:51 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25dac92-4b0a-4491-ae18-50d071283a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:51 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Volume volume-7942343c-b8eb-497d-8be1-743b82e4ca1f (7942343c-b8eb-497d-8be1-743b82e4ca1f): created successfully Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25dac92-4b0a-4491-ae18-50d071283a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (b40e3722-9edf-4b85-ac16-12882d882b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8f5a2fd0-a65c-45f6-b462-8784cbe1f4df tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:27:51 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e 1073741824" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:51 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e Nov 05 08:27:51 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:52 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abea547e-b981-4433-bdf0-c8aaaa7776d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3926ee27-4075-4d5e-ac1c-0d86f685549e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c7ec42-9605-4f2c-a8f4-681d434c3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Volume volume-3926ee27-4075-4d5e-ac1c-0d86f685549e (3926ee27-4075-4d5e-ac1c-0d86f685549e): created successfully Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c7ec42-9605-4f2c-a8f4-681d434c3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Flow 'volume_create_manager' (55d9df36-cd78-430e-8469-47f70407b78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-53541a34-af70-4c57-9ea5-0b5825fa7fa2 tempest-AttachVolumeShelveTestJSON-750476140 None] Created volume successfully. Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-7942343c-b8eb-497d-8be1-743b82e4ca1f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "cinder-7942343c-b8eb-497d-8be1-743b82e4ca1f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-7942343c-b8eb-497d-8be1-743b82e4ca1f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-7942343c-b8eb-497d-8be1-743b82e4ca1f" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50cc9a1-1a14-40f2-899e-28eb36ca092b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:52 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f Nov 05 08:27:52 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:53 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f" returned: 0 in 0.567s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f Nov 05 08:27:53 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (dfd6bc61-621c-4568-9c98-732bb9d57988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77de5062-e3f2-408d-ba79-506517dea172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77de5062-e3f2-408d-ba79-506517dea172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131830973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce8510d-9a3e-40ef-911f-b0d60beb0206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:53Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd61cd3-2d14-4862-adb7-432862394227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd61cd3-2d14-4862-adb7-432862394227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f24e423-bc2a-4e36-8459-8155d617306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f24e423-bc2a-4e36-8459-8155d617306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce8510d-9a3e-40ef-911f-b0d60beb0206', 'volume_name': 'volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf14b23-f2ba-4f57-848a-c1de1860837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf14b23-f2ba-4f57-848a-c1de1860837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7f7a0e-39c9-42b4-8997-069fb2d15d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:53 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Volume 9ce8510d-9a3e-40ef-911f-b0d60beb0206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206', 'volume_size': 1} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131830973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce8510d-9a3e-40ef-911f-b0d60beb0206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:53Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Creating volume 9ce8510d-9a3e-40ef-911f-b0d60beb0206 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:53 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:53 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 1073741824 Nov 05 08:27:53 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7942343c-b8eb-497d-8be1-743b82e4ca1f" returned: 0 in 0.610s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-7942343c-b8eb-497d-8be1-743b82e4ca1f" released by "delete_volume" :: held 1.261s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Created reservations ['a8caff90-b469-478a-b145-b29b8671c092', '4caa655f-1b05-4c1f-b72f-c4310f02ae4a', 'b701b191-a816-496f-8587-b5524c2e8d65', '8fabaef4-ccd0-4e9a-80d7-0e935aa281f9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:53 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:54 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.442s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd8db7ae-f4a6-4563-b55a-d07e0ed4fc0b tempest-VolumesGetTest-543604025 None] Lock "cinder-7942343c-b8eb-497d-8be1-743b82e4ca1f-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:54 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 1073741824" returned: 0 in 0.823s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:54 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 Nov 05 08:27:54 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "cinder-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:54 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206" returned: 0 in 0.543s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" acquired by "delete_volume" :: waited 0.076s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7f7a0e-39c9-42b4-8997-069fb2d15d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4269bb8-4457-4ad1-bc7e-cdc8162886fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd3657-13e0-4a51-97d1-f4201d682a01]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:55 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Volume volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 (9ce8510d-9a3e-40ef-911f-b0d60beb0206): created successfully Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4269bb8-4457-4ad1-bc7e-cdc8162886fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (dfd6bc61-621c-4568-9c98-732bb9d57988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c2878ebb-3186-468b-b0d3-729ad474f4fb tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:27:55 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c Nov 05 08:27:55 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-53710b88-5604-4e95-8137-ea98a28c8662 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206" by "attach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-53710b88-5604-4e95-8137-ea98a28c8662 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206" acquired by "attach_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-53710b88-5604-4e95-8137-ea98a28c8662 tempest-VolumesActionsTest-1911927448 None] Attaching volume 9ce8510d-9a3e-40ef-911f-b0d60beb0206 to instance 84ad6c4a-f9fb-4bed-9094-7ee11fb68bcb at mountpoint /dev/vdb on host None. Nov 05 08:27:55 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-53710b88-5604-4e95-8137-ea98a28c8662 tempest-VolumesActionsTest-1911927448 None] Attach volume completed successfully. Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-53710b88-5604-4e95-8137-ea98a28c8662 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206" released by "attach_volume" :: held 0.149s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:55 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c Nov 05 08:27:55 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:55 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" returned: 0 in 0.313s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c" released by "delete_volume" :: held 0.911s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Created reservations ['a9e41e4a-d02d-4f8a-b2af-1b6237682955', '480e549a-8101-4a3f-af65-89f7dcaa3dee', '598e8e7f-8a86-448d-860d-a5072fdaec02', '343a4929-b8cb-4f28-85ab-b2f6ec29548a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:56 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:56 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:56 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8ae04d47-8f52-44d9-9089-1cf6e2745d3f tempest-VolumesGetTest-543604025 None] Lock "cinder-94f18e4a-1ff7-4b40-96d3-cbffb8242e4c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Terminate volume connection completed successfully. Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" by "detach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Detaching volume 9ce8510d-9a3e-40ef-911f-b0d60beb0206 from instance 84ad6c4a-f9fb-4bed-9094-7ee11fb68bcb. Nov 05 08:27:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Detach volume completed successfully. Nov 05 08:27:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c9418c35-5671-4c0c-95b2-5279bf3abd8e tempest-VolumesActionsTest-1479183970 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bab5bcdb-27ed-4ec4-83f0-3c48fd76aa56 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" by "detach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bab5bcdb-27ed-4ec4-83f0-3c48fd76aa56 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bab5bcdb-27ed-4ec4-83f0-3c48fd76aa56 tempest-VolumesActionsTest-1911927448 None] Volume detach called, but volume not attached. Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bab5bcdb-27ed-4ec4-83f0-3c48fd76aa56 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-e1c9132f-6db4-4a18-88d7-958c11ddd0b8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "cinder-e1c9132f-6db4-4a18-88d7-958c11ddd0b8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[05da7058-277c-474d-833a-f4fa9700ae1a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-quobyte-9ce8510d-9a3e-40ef-911f-b0d60beb0206" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-quobyte-9ce8510d-9a3e-40ef-911f-b0d60beb0206" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:57 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23719ce-169a-48a6-a5f0-feeff98275ce]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:57 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 Nov 05 08:27:57 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.546s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8 Nov 05 08:27:58 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206" returned: 0 in 0.553s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206 Nov 05 08:27:58 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" returned: 0 in 0.370s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-e1c9132f-6db4-4a18-88d7-958c11ddd0b8" released by "delete_volume" :: held 1.065s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Created reservations ['c135c7b3-2886-443d-8435-3c004eb47036', 'ba5d4a76-078f-4369-80d5-75873e0f92f4', 'c438b91a-7f27-4049-9bd8-b08293e3a74e', '6c136a2f-a9ad-4516-9079-0b367a14bf6d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ce8510d-9a3e-40ef-911f-b0d60beb0206" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:58 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-quobyte-9ce8510d-9a3e-40ef-911f-b0d60beb0206" released by "delete_volume" :: held 1.018s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Created reservations ['f42fa9c9-60b9-4c8a-b2cd-636154ab9f16', '44fc51c5-6632-4a09-a6b8-eaeb988155e9', '145375e1-695d-491f-a876-b3b312bea825', '554aaaa7-b4c0-4977-bf2a-d9c497625241'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:27:58 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.339s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:27:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3abf4b31-528e-4e9f-85aa-42d40c2aa661 tempest-VolumesGetTest-543604025 None] Lock "cinder-e1c9132f-6db4-4a18-88d7-958c11ddd0b8-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:59 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.401s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:59 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Deleted volume successfully. Nov 05 08:27:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f12b7142-5554-4c21-8b7d-bf3740a0fc53 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-9ce8510d-9a3e-40ef-911f-b0d60beb0206-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (1e090294-875a-4226-918e-51adf62e8b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ad2035-0ce7-4d94-a1b1-d95dbdcf6414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ad2035-0ce7-4d94-a1b1-d95dbdcf6414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754170666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32be958b-9fbf-4ddd-a35b-39dd8fd4f88e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:01Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e2b4bd-49bf-48b3-a6b6-e51d5f3f99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e2b4bd-49bf-48b3-a6b6-e51d5f3f99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcee0ba2-5a91-4c63-bf76-3c65d5417093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:00 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcee0ba2-5a91-4c63-bf76-3c65d5417093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32be958b-9fbf-4ddd-a35b-39dd8fd4f88e', 'volume_name': 'volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26389a-86be-4d90-99c6-2746691ccb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26389a-86be-4d90-99c6-2746691ccb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360b22fd-9c2b-49da-94a0-eb26b8987f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:01 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Trying to clone 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e from image 0f972b89-5809-49af-bb61-4f969e240750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:28:01 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7f7e1-14b3-4083-9b8e-d5dcff951542]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD Nov 05 08:28:02 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:02 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 is fetched for user 1e071569adb9460498befe5b054b4484. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d276f9a-dde0-4d28-af98-9871eb85844d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD Nov 05 08:28:02 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:02 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754170666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32be958b-9fbf-4ddd-a35b-39dd8fd4f88e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:01Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Creating volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:02 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1073741824 Nov 05 08:28:02 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:03 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1073741824" returned: 0 in 1.004s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:03 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (5e884c5f-bc92-44e4-8755-be2ffff18e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7231ae-23a9-4f72-a004-6406cfdbec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7231ae-23a9-4f72-a004-6406cfdbec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1963902050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d570aeb4-5fe9-4239-ac94-5baf1661377d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:04Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea601211-5dba-4541-9716-2972f4533d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea601211-5dba-4541-9716-2972f4533d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:04 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cd0c3d-dddf-4755-b300-7964170ba8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:04 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cd0c3d-dddf-4755-b300-7964170ba8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd570aeb4-5fe9-4239-ac94-5baf1661377d', 'volume_name': 'volume-d570aeb4-5fe9-4239-ac94-5baf1661377d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe0bd2b-59fa-4261-81a2-526d1b588c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe0bd2b-59fa-4261-81a2-526d1b588c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924f9b5d-cb9b-4a96-8746-08c635c88daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:04 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Volume d570aeb4-5fe9-4239-ac94-5baf1661377d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d570aeb4-5fe9-4239-ac94-5baf1661377d', 'volume_size': 1} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:04 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.227s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1963902050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d570aeb4-5fe9-4239-ac94-5baf1661377d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:04Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Creating volume d570aeb4-5fe9-4239-ac94-5baf1661377d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:04 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d 1073741824 Nov 05 08:28:04 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Attempting download of 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98fcab1-192d-45b2-98b7-640e9b103728]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq Nov 05 08:28:04 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d 1073741824" returned: 0 in 0.437s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d Nov 05 08:28:04 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq Nov 05 08:28:04 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq" returned: 1 in 0.368s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_43v9whhq' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:28:05 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a624d399-7462-456d-bb44-c91345f6a8fe]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924f9b5d-cb9b-4a96-8746-08c635c88daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d570aeb4-5fe9-4239-ac94-5baf1661377d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5789b0cd-5108-4437-909f-df82b2df75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Volume volume-d570aeb4-5fe9-4239-ac94-5baf1661377d (d570aeb4-5fe9-4239-ac94-5baf1661377d): created successfully Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5789b0cd-5108-4437-909f-df82b2df75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (5e884c5f-bc92-44e4-8755-be2ffff18e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d633a389-4a0a-42d1-90a7-c85f195bcb66 tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:28:05 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD Nov 05 08:28:05 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] 0f972b89-5809-49af-bb61-4f969e240750 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:28:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e Nov 05 08:28:05 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-d570aeb4-5fe9-4239-ac94-5baf1661377d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-d570aeb4-5fe9-4239-ac94-5baf1661377d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-e902c9b0-6105-4920-8ac2-96a4e7955a6e req-30cdd839-e434-4801-a86d-ea02edf2ea5f tempest-AttachVolumeShelveTestJSON-750476140 None] No connector for attachment 34cbca4b-1919-443a-9a3c-24120086ebd2; skipping storage backend terminate_connection call. {{(pid=87101) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-e902c9b0-6105-4920-8ac2-96a4e7955a6e req-30cdd839-e434-4801-a86d-ea02edf2ea5f tempest-AttachVolumeShelveTestJSON-750476140 None] Deleting attachment 34cbca4b-1919-443a-9a3c-24120086ebd2. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-quobyte-d570aeb4-5fe9-4239-ac94-5baf1661377d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-d570aeb4-5fe9-4239-ac94-5baf1661377d" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50d9a6-59af-4e43-af03-ac370fbaa494]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:06 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d Nov 05 08:28:06 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:06 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d" returned: 0 in 0.525s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:07 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d Nov 05 08:28:07 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:07 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d570aeb4-5fe9-4239-ac94-5baf1661377d" returned: 0 in 0.431s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-d570aeb4-5fe9-4239-ac94-5baf1661377d" released by "delete_volume" :: held 1.034s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Created reservations ['5216bd55-32a7-4a14-b173-fbbaf827a61f', 'a0f273b0-80d2-445e-b29a-98da15f441bd', 'c0b526f0-10d6-4076-81aa-9144aa2152ca', 'e3e251d6-854b-477d-88a1-5b4331f5297c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:07 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:07 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:08 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.380s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Deleted volume successfully. Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb8eec61-cd4a-4f1c-be3d-1087f6be5e77 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-d570aeb4-5fe9-4239-ac94-5baf1661377d-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:08 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" returned: 0 in 2.947s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_nb63jblydevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:28:08 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Converted 112.00 MB image at 38.00 MB/s Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:08 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1G Nov 05 08:28:08 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:08 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e 1G" returned: 0 in 0.498s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:08 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Downloaded image 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 for user 1e071569adb9460498befe5b054b4484 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Marking volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Copying metadata from image 0f972b89-5809-49af-bb61-4f969e240750 to 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Creating volume glance metadata for volume 32be958b-9fbf-4ddd-a35b-39dd8fd4f88e backed by image 0f972b89-5809-49af-bb61-4f969e240750 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360b22fd-9c2b-49da-94a0-eb26b8987f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a7a93c-5abb-4f8c-a5ee-77a4ec65851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Volume volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e (32be958b-9fbf-4ddd-a35b-39dd8fd4f88e): created successfully Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a7a93c-5abb-4f8c-a5ee-77a4ec65851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (1e090294-875a-4226-918e-51adf62e8b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1af14c4f-b96e-4162-8979-a4ab3fa1c44a tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (6e0d0c95-3f45-4f72-8d96-a74c68935b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9c7aa9-3ba5-4515-9141-cc0ce5cc4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9c7aa9-3ba5-4515-9141-cc0ce5cc4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1459119878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd8507b-d34e-4501-b123-13c22dd59821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:09Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72441c6-7302-4fc8-82ce-be1b150c0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72441c6-7302-4fc8-82ce-be1b150c0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d4e63-9390-4ada-a147-a697cec95f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d4e63-9390-4ada-a147-a697cec95f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd8507b-d34e-4501-b123-13c22dd59821', 'volume_name': 'volume-8bd8507b-d34e-4501-b123-13c22dd59821', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a825318-970b-4637-a558-f43922e86c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a825318-970b-4637-a558-f43922e86c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc737315-93d4-47c2-89c6-cbab0863f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Volume 8bd8507b-d34e-4501-b123-13c22dd59821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd8507b-d34e-4501-b123-13c22dd59821', 'volume_size': 1} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1459119878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd8507b-d34e-4501-b123-13c22dd59821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:09Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Creating volume 8bd8507b-d34e-4501-b123-13c22dd59821 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:09 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:09 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 1073741824 Nov 05 08:28:09 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 1073741824" returned: 0 in 0.667s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 Nov 05 08:28:10 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (69d10ce4-1ea0-43af-ac48-867c7145c8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b136b0-7126-4992-a28e-66aae08ab549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b136b0-7126-4992-a28e-66aae08ab549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1845274701',display_name='tempest-VolumesGetTest-Volume-1184881765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb39f8c-a456-43b9-aa1a-a2c2dbac39f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:10Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc07bea-2508-4696-b1c6-d41af351a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc07bea-2508-4696-b1c6-d41af351a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530608d0-5eba-4aaa-8491-08565a3bcef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530608d0-5eba-4aaa-8491-08565a3bcef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb39f8c-a456-43b9-aa1a-a2c2dbac39f8', 'volume_name': 'volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f353c5-5d1f-425c-9012-c72d3999cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f353c5-5d1f-425c-9012-c72d3999cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a617c8-a9fd-4c13-a1a8-263615e5a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Volume adb39f8c-a456-43b9-aa1a-a2c2dbac39f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8', 'volume_size': 1} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:10 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821" returned: 0 in 0.352s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1845274701',display_name='tempest-VolumesGetTest-Volume-1184881765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb39f8c-a456-43b9-aa1a-a2c2dbac39f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2966fe2f483e4099a5cec05963ab0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:10Z,use_quota=True,user_id='1e071569adb9460498befe5b054b4484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Creating volume adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:10 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 1073741824 Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc737315-93d4-47c2-89c6-cbab0863f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd8507b-d34e-4501-b123-13c22dd59821', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c137d4f-8c07-48db-ae78-9908e1ccc745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Volume volume-8bd8507b-d34e-4501-b123-13c22dd59821 (8bd8507b-d34e-4501-b123-13c22dd59821): created successfully Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c137d4f-8c07-48db-ae78-9908e1ccc745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (6e0d0c95-3f45-4f72-8d96-a74c68935b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c5f60548-7724-47c3-9b78-a9fcd5abc12b tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:28:11 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 1073741824" returned: 0 in 0.557s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:11 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 Nov 05 08:28:11 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:11 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a617c8-a9fd-4c13-a1a8-263615e5a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7dac14-44f2-4835-aa53-bd704f9ae7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:11 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Volume volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 (adb39f8c-a456-43b9-aa1a-a2c2dbac39f8): created successfully Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7dac14-44f2-4835-aa53-bd704f9ae7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Flow 'volume_create_manager' (69d10ce4-1ea0-43af-ac48-867c7145c8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2ab73c58-769e-43d0-be97-309ef22b8573 tempest-VolumesGetTest-543604025 None] Created volume successfully. Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-8bd8507b-d34e-4501-b123-13c22dd59821-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "cinder-8bd8507b-d34e-4501-b123-13c22dd59821-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-b2ad790c-367c-4f29-b071-4260679cc334 req-ad52e60a-1384-4d34-ab02-81ad93a5a5eb tempest-AttachVolumeNegativeTest-1576733215 None] Terminate volume connection completed successfully. Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-b2ad790c-367c-4f29-b071-4260679cc334 req-ad52e60a-1384-4d34-ab02-81ad93a5a5eb tempest-AttachVolumeNegativeTest-1576733215 None] Deleting attachment ef3570be-9a82-4f1b-9d54-827d3ac78229. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-quobyte-8bd8507b-d34e-4501-b123-13c22dd59821" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-8bd8507b-d34e-4501-b123-13c22dd59821" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fcba97-edfc-44f7-88ea-02ce34400b47]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:12 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 Nov 05 08:28:12 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:12 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821" returned: 0 in 0.436s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:12 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821 Nov 05 08:28:12 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "cinder-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:12 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8bd8507b-d34e-4501-b123-13c22dd59821" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426f2c3-e5fc-482c-9c94-8ad629961e9c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-8bd8507b-d34e-4501-b123-13c22dd59821" released by "delete_volume" :: held 0.943s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Created reservations ['10602b54-eb7a-4c95-a228-8949e08b31c3', '98b31db2-d8a1-45b6-8339-09219e517c4a', 'ac8d3a8a-9ea4-4c01-8a05-fd50d5dd47cc', 'af79afd6-c9bc-4d3f-86e8-c4e3a2c14659'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:13 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:13 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:13 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 Nov 05 08:28:13 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:13 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Deleted volume successfully. Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b16ca99-6d62-461f-9211-0ff71cbc42ff tempest-VolumesActionsTest-1479183970 None] Lock "cinder-8bd8507b-d34e-4501-b123-13c22dd59821-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:13 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" returned: 0 in 0.748s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:13 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8 Nov 05 08:28:13 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:13 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8" released by "delete_volume" :: held 1.184s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:13 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Created reservations ['a20c9be7-7808-4ecc-8dcc-07a2ba6dad8e', '654096c8-2499-4b5b-8a2a-3bcb21f39794', 'd9929788-3ae7-4e87-a678-5d44e77a704d', 'f7360b35-d0ac-4e34-b3ad-0e2860263273'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:14 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:14 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:14 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.513s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:28:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2837bf2-92ee-49eb-8a0e-1a299f6c5527 tempest-VolumesGetTest-543604025 None] Lock "cinder-adb39f8c-a456-43b9-aa1a-a2c2dbac39f8-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (dc37813e-1275-45c8-bedc-78a8816941b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a2b95-eb80-4876-a33c-330d2f2e2c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a2b95-eb80-4876-a33c-330d2f2e2c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929691382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:15Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c472a-8e1b-4cf0-9a0a-21eede70a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c472a-8e1b-4cf0-9a0a-21eede70a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef08d1-baf6-43c0-bd13-8adb3eb0e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef08d1-baf6-43c0-bd13-8adb3eb0e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d', 'volume_name': 'volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045df750-2cc8-49e6-8bb4-63ac4e3055db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045df750-2cc8-49e6-8bb4-63ac4e3055db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce8addd-b0c2-4697-8949-921e07aeafe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Volume 52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d', 'volume_size': 1} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929691382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:15Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Creating volume 52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:15 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "cinder-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:15 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d 1073741824 Nov 05 08:28:15 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Acquiring lock "cinder-quobyte-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1a7a2-3370-4e17-93e2-8f9e95085219]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:15 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e Nov 05 08:28:15 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:15 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" returned: 0 in 0.501s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:15 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d 1073741824" returned: 0 in 0.719s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e Nov 05 08:28:16 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:16 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d Nov 05 08:28:16 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:16 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:16 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce8addd-b0c2-4697-8949-921e07aeafe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7d6e13-10b6-4546-a792-33722888654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" returned: 0 in 0.458s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "cinder-quobyte-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e" released by "delete_volume" :: held 1.051s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Volume volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d (52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d): created successfully Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7d6e13-10b6-4546-a792-33722888654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (dc37813e-1275-45c8-bedc-78a8816941b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c27ea1f4-2545-4347-a36c-0d80ad52be01 tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Created reservations ['88dcd053-0d9a-41ce-86ee-57e6e9ef79a9', '49b66bc5-63bc-439c-a202-44cac567730e', '8a9cd8e3-e9b2-425d-a6ee-50c54b98ef3a', 'bfc9a157-184b-4447-965a-efa524d23929'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:16 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:16 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:16 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Deleted volume successfully. Nov 05 08:28:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b5a14cf-584b-4095-b082-b8c96a545d88 tempest-VolumesGetTest-543604025 None] Lock "cinder-32be958b-9fbf-4ddd-a35b-39dd8fd4f88e-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-quobyte-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceff4ac-d23c-4fec-87d6-fd6abfe0df96]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:17 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d Nov 05 08:28:17 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:17 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" returned: 0 in 0.460s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:17 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d Nov 05 08:28:17 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:18 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d" released by "delete_volume" :: held 0.878s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Created reservations ['3f05a228-e1cb-46d6-a54c-bdc9d7d3eade', '3af02e05-f926-4685-9ba3-9321516a8c2f', '46b68775-20d6-42d4-a221-2cd7caa93e97', 'e4b8804f-5394-4b1e-8262-0f2bfc5480c5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:18 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:18 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:18 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Deleted volume successfully. Nov 05 08:28:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b69119d-9555-48ca-91c6-a05530f89841 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-52f9f2cb-2a2c-4a0a-9f2f-bac47e63132d-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (24041eed-2305-46ca-9834-507280e779bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9010705b-0c8a-424c-92d9-4d452f2c1514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9010705b-0c8a-424c-92d9-4d452f2c1514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1901098946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f669aa5f-532c-49b1-bd3e-77b4a38fd96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:20Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e55b43-7258-41a5-b743-5066f4277a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e55b43-7258-41a5-b743-5066f4277a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0894877d-1654-4cbc-923c-98df7a152f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0894877d-1654-4cbc-923c-98df7a152f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f669aa5f-532c-49b1-bd3e-77b4a38fd96e', 'volume_name': 'volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6acbff-7539-466a-afa2-91b245159328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6acbff-7539-466a-afa2-91b245159328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70e8176-a288-41ef-9300-b6593b6d2fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Volume f669aa5f-532c-49b1-bd3e-77b4a38fd96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e', 'volume_size': 1} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1901098946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f669aa5f-532c-49b1-bd3e-77b4a38fd96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:20Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Creating volume f669aa5f-532c-49b1-bd3e-77b4a38fd96e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:20 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:20 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e 1073741824 Nov 05 08:28:20 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:20 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e 1073741824" returned: 0 in 0.851s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:21 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e Nov 05 08:28:21 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:21 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" returned: 0 in 0.481s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70e8176-a288-41ef-9300-b6593b6d2fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3918508-70ab-42f4-883a-2c7d170147b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:21 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Volume volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e (f669aa5f-532c-49b1-bd3e-77b4a38fd96e): created successfully Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3918508-70ab-42f4-883a-2c7d170147b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (24041eed-2305-46ca-9834-507280e779bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dc5a040a-fb3c-42d3-bad9-7e4946632e37 tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-f669aa5f-532c-49b1-bd3e-77b4a38fd96e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-f669aa5f-532c-49b1-bd3e-77b4a38fd96e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "cinder-quobyte-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810ad93-57c1-4690-97bd-6e044d602c5a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e Nov 05 08:28:22 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" returned: 0 in 0.549s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e Nov 05 08:28:22 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:23 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" returned: 0 in 0.467s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-quobyte-f669aa5f-532c-49b1-bd3e-77b4a38fd96e" released by "delete_volume" :: held 1.122s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Created reservations ['f9ac5868-1b2b-42a8-bf8f-955768590535', 'a6588157-44ce-4008-86fe-dc2a99925145', '9567912f-89f1-4068-89e5-8de7279571f2', 'b2314b3d-9148-414d-a1ba-0c2fd8dab76f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:23 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:23 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:23 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Deleted volume successfully. Nov 05 08:28:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6053bb0c-e8bb-4314-94f3-9bcfa9f04f78 tempest-VolumesActionsTest-1479183970 None] Lock "cinder-f669aa5f-532c-49b1-bd3e-77b4a38fd96e-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (9410d033-10d8-4474-96de-0f5cdd30a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a0b95c-cdaa-4017-8665-2750024ac233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a0b95c-cdaa-4017-8665-2750024ac233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966829023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc20aea-bb9f-4d49-9442-a1db810852d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:25Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9db9a9-eedb-407e-a3e8-801a5b046326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9db9a9-eedb-407e-a3e8-801a5b046326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24c3b70-09b7-483a-a2c2-468397ffb89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24c3b70-09b7-483a-a2c2-468397ffb89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc20aea-bb9f-4d49-9442-a1db810852d5', 'volume_name': 'volume-1fc20aea-bb9f-4d49-9442-a1db810852d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9629d2d-96eb-4df7-8116-1e6bd3408e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9629d2d-96eb-4df7-8116-1e6bd3408e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2d8bb3-4bd1-441b-8ac1-783768e2ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Volume 1fc20aea-bb9f-4d49-9442-a1db810852d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc20aea-bb9f-4d49-9442-a1db810852d5', 'volume_size': 1} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966829023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc20aea-bb9f-4d49-9442-a1db810852d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:25Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Creating volume 1fc20aea-bb9f-4d49-9442-a1db810852d5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:25 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 1073741824 Nov 05 08:28:25 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (20449b06-c1a4-4f4e-a155-1ccefaaed9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8ec112-9631-4be3-a3d7-7ee35d437cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8ec112-9631-4be3-a3d7-7ee35d437cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652928796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c474d666-e948-435e-8d8d-1a95bcd8cd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:25Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e39c20-c439-4524-b7e9-6ab05f072810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e39c20-c439-4524-b7e9-6ab05f072810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b2df87-61c6-4d0a-a40e-9f83cd295745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b2df87-61c6-4d0a-a40e-9f83cd295745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c474d666-e948-435e-8d8d-1a95bcd8cd6c', 'volume_name': 'volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2b78bb-d1a3-4cba-9525-215e834db4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2b78bb-d1a3-4cba-9525-215e834db4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa486ef2-7bc6-4cba-b378-63b2885cf2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Volume c474d666-e948-435e-8d8d-1a95bcd8cd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c', 'volume_size': 1} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:25 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 1073741824" returned: 0 in 0.576s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 Nov 05 08:28:25 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:26 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652928796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c474d666-e948-435e-8d8d-1a95bcd8cd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99ec0d9364e486aaddb6d7a93aa7bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:25Z,use_quota=True,user_id='82a46cdc4196430587de633adcbe022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Creating volume c474d666-e948-435e-8d8d-1a95bcd8cd6c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:26 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2d8bb3-4bd1-441b-8ac1-783768e2ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc20aea-bb9f-4d49-9442-a1db810852d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:26 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c 1073741824 Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363ea69a-fb50-4da8-b07e-4aa46bd4d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:26 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:26 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Volume volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 (1fc20aea-bb9f-4d49-9442-a1db810852d5): created successfully Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363ea69a-fb50-4da8-b07e-4aa46bd4d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (9410d033-10d8-4474-96de-0f5cdd30a75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fe839054-3c71-4940-abe5-da1f2bb6d330 tempest-VolumesListTestJSON-232780031 None] Created volume successfully. Nov 05 08:28:26 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c 1073741824" returned: 0 in 0.610s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:26 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c Nov 05 08:28:26 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:27 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c" returned: 0 in 0.700s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa486ef2-7bc6-4cba-b378-63b2885cf2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339aa22b-074f-4b10-8456-70ed00409c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Volume volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c (c474d666-e948-435e-8d8d-1a95bcd8cd6c): created successfully Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339aa22b-074f-4b10-8456-70ed00409c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Flow 'volume_create_manager' (20449b06-c1a4-4f4e-a155-1ccefaaed9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0d97999c-2d96-414f-b0f5-616d617523a8 tempest-VolumesActionsTest-1911927448 None] Created volume successfully. Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (69620cfe-e5bc-4b0f-8e1e-938271767ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56990e16-e275-428a-b10e-204a63dc34cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56990e16-e275-428a-b10e-204a63dc34cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477033879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b5ed66-87ef-4da0-ad21-742ec633421a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:28Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c4227-bbfc-4772-a14f-7013978494f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c4227-bbfc-4772-a14f-7013978494f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237e290-8994-43d1-8b0f-e90d8d13bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237e290-8994-43d1-8b0f-e90d8d13bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b5ed66-87ef-4da0-ad21-742ec633421a', 'volume_name': 'volume-68b5ed66-87ef-4da0-ad21-742ec633421a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e8f073-2e8a-4eed-87be-459a29e70e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e8f073-2e8a-4eed-87be-459a29e70e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc820de-0e03-4062-9cea-73061fc2dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:28 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Volume 68b5ed66-87ef-4da0-ad21-742ec633421a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b5ed66-87ef-4da0-ad21-742ec633421a', 'volume_size': 1} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477033879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b5ed66-87ef-4da0-ad21-742ec633421a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:28Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Creating volume 68b5ed66-87ef-4da0-ad21-742ec633421a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:28 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:28 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a 1073741824 Nov 05 08:28:28 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:28 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a 1073741824" returned: 0 in 0.737s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:29 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a Nov 05 08:28:29 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:29 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc820de-0e03-4062-9cea-73061fc2dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b5ed66-87ef-4da0-ad21-742ec633421a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764839a1-8731-4db0-92da-7421539a803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:29 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Volume volume-68b5ed66-87ef-4da0-ad21-742ec633421a (68b5ed66-87ef-4da0-ad21-742ec633421a): created successfully Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764839a1-8731-4db0-92da-7421539a803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (69620cfe-e5bc-4b0f-8e1e-938271767ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9f801676-e5d3-4718-80e7-71c3141cfe04 tempest-VolumesListTestJSON-232780031 None] Created volume successfully. Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-c474d666-e948-435e-8d8d-1a95bcd8cd6c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-c474d666-e948-435e-8d8d-1a95bcd8cd6c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "cinder-quobyte-c474d666-e948-435e-8d8d-1a95bcd8cd6c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-quobyte-c474d666-e948-435e-8d8d-1a95bcd8cd6c" acquired by "delete_volume" :: waited 0.032s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[451a22ee-ba7b-4e4a-a564-a2a9cd957ef8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:29 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c Nov 05 08:28:29 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:30 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c" returned: 0 in 0.734s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:30 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c Nov 05 08:28:30 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:31 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c474d666-e948-435e-8d8d-1a95bcd8cd6c" returned: 0 in 0.680s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-quobyte-c474d666-e948-435e-8d8d-1a95bcd8cd6c" released by "delete_volume" :: held 1.533s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Created reservations ['8c6b2519-5156-4373-a391-81f9e98073b3', '4248cbfb-5293-43f7-936e-2aed862bae57', '0ac5f563-b671-4493-8b1c-a1546a7436da', 'a33d3899-04a5-4c2e-b143-033b51260e69'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:31 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:31 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (a2fdb634-1b90-4078-9d96-b6775aa4d90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80532c0b-aacb-483d-830b-a43165dda7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80532c0b-aacb-483d-830b-a43165dda7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-541820675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f39b29-4871-4a4f-9a91-5cd697ac8297,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:32Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f02b82-f34f-4322-8a1d-99612b4929b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f02b82-f34f-4322-8a1d-99612b4929b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5fbe19-549c-4c0d-8b7a-ab18fdb97a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5fbe19-549c-4c0d-8b7a-ab18fdb97a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f39b29-4871-4a4f-9a91-5cd697ac8297', 'volume_name': 'volume-95f39b29-4871-4a4f-9a91-5cd697ac8297', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff05cfe-4c66-4fb8-b3ac-1a29e4959deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff05cfe-4c66-4fb8-b3ac-1a29e4959deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c44c472-3d5c-4c0b-8c7c-5149db19c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Volume 95f39b29-4871-4a4f-9a91-5cd697ac8297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f39b29-4871-4a4f-9a91-5cd697ac8297', 'volume_size': 1} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-541820675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f39b29-4871-4a4f-9a91-5cd697ac8297,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7da695ba26c456f9c43bd840eac253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:32Z,use_quota=True,user_id='3c052b22de2d4512a16d3be7b9afb136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Creating volume 95f39b29-4871-4a4f-9a91-5cd697ac8297 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:31 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:31 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 1073741824 Nov 05 08:28:31 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:32 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.742s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:32 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:32 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Deleted volume successfully. Nov 05 08:28:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d42b4841-7ee5-4119-934f-eb40e7f663e2 tempest-VolumesActionsTest-1911927448 None] Lock "cinder-c474d666-e948-435e-8d8d-1a95bcd8cd6c-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:32 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 1073741824" returned: 0 in 1.034s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:33 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 Nov 05 08:28:33 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:33 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297" returned: 0 in 0.376s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c44c472-3d5c-4c0b-8c7c-5149db19c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f39b29-4871-4a4f-9a91-5cd697ac8297', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c707ded-088b-4dc7-8234-407ec011f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Volume volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 (95f39b29-4871-4a4f-9a91-5cd697ac8297): created successfully Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c707ded-088b-4dc7-8234-407ec011f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Flow 'volume_create_manager' (a2fdb634-1b90-4078-9d96-b6775aa4d90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3375c9fe-36be-44c2-a1a4-f57baf35b71d tempest-VolumesListTestJSON-232780031 None] Created volume successfully. Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-95f39b29-4871-4a4f-9a91-5cd697ac8297-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-95f39b29-4871-4a4f-9a91-5cd697ac8297-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-quobyte-95f39b29-4871-4a4f-9a91-5cd697ac8297" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-95f39b29-4871-4a4f-9a91-5cd697ac8297" acquired by "delete_volume" :: waited 0.058s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6406637-86a5-4ebf-a877-08e53fedee21]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:36 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 Nov 05 08:28:36 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:37 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:37 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297 Nov 05 08:28:37 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:37 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-95f39b29-4871-4a4f-9a91-5cd697ac8297" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-95f39b29-4871-4a4f-9a91-5cd697ac8297" released by "delete_volume" :: held 0.770s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Created reservations ['5bd95cec-e150-4527-9397-ba3be8471d50', '8fe01e3e-2333-46db-865d-62a0afc3246a', 'f0718f04-b615-4594-bdf3-706050d96cda', 'c94daba8-9a5b-491c-b05c-ede4bca34b24'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:37 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:37 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-68b5ed66-87ef-4da0-ad21-742ec633421a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "cinder-68b5ed66-87ef-4da0-ad21-742ec633421a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-quobyte-68b5ed66-87ef-4da0-ad21-742ec633421a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-68b5ed66-87ef-4da0-ad21-742ec633421a" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e35251a-993f-4501-ac4b-366ca9d5ff39]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:38 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.442s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Deleted volume successfully. Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-07a142d4-db90-41c0-8315-19320e089816 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-95f39b29-4871-4a4f-9a91-5cd697ac8297-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:38 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a Nov 05 08:28:38 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:38 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:38 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a Nov 05 08:28:38 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:38 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68b5ed66-87ef-4da0-ad21-742ec633421a" returned: 0 in 0.288s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-68b5ed66-87ef-4da0-ad21-742ec633421a" released by "delete_volume" :: held 0.773s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Created reservations ['f67a104d-3dc9-484e-b8c8-95b9e4398319', '1806fd87-8b9e-4d6e-81e6-3ce132fbb045', 'c961b4b9-6265-4dd0-b221-4405667d101c', '576969fc-9df9-4157-a425-7f9b49943e12'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:39 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:39 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:39 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Deleted volume successfully. Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-1fc20aea-bb9f-4d49-9442-a1db810852d5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f41830ca-9b30-48d7-b59e-182448483aca tempest-VolumesListTestJSON-232780031 None] Lock "cinder-68b5ed66-87ef-4da0-ad21-742ec633421a-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-1fc20aea-bb9f-4d49-9442-a1db810852d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=145,cinder:SELECT=116,cinder:DELETE=10,cinder:INSERT=40 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=160,cinder:SELECT=105,cinder:INSERT=41,cinder:DELETE=17 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "cinder-quobyte-1fc20aea-bb9f-4d49-9442-a1db810852d5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-1fc20aea-bb9f-4d49-9442-a1db810852d5" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[329632cd-d047-4301-9951-4a2890cfaab4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:39 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 Nov 05 08:28:39 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:39 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5" returned: 0 in 0.405s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:39 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5 Nov 05 08:28:39 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:40 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1fc20aea-bb9f-4d49-9442-a1db810852d5" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-quobyte-1fc20aea-bb9f-4d49-9442-a1db810852d5" released by "delete_volume" :: held 0.797s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Created reservations ['a3973f86-dd4a-4764-a35d-75bafaa15bb9', '4ebed919-19d1-45d3-b579-244f609c20b3', '899845a8-f500-4b72-9bf5-b51f7f38a7c4', '36b4d21a-fbf3-43ab-ba7a-1509df1bb36d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:40 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:40 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:40 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Deleted volume successfully. Nov 05 08:28:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0b5468d5-d3ea-46a3-b9c8-2fa780f6c409 tempest-VolumesListTestJSON-232780031 None] Lock "cinder-1fc20aea-bb9f-4d49-9442-a1db810852d5-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:48 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:48 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:48 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.331s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:28:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Acquiring lock "cinder-3926ee27-4075-4d5e-ac1c-0d86f685549e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "cinder-3926ee27-4075-4d5e-ac1c-0d86f685549e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Acquiring lock "cinder-quobyte-3926ee27-4075-4d5e-ac1c-0d86f685549e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "cinder-quobyte-3926ee27-4075-4d5e-ac1c-0d86f685549e" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[af276c2f-2d9f-43b9-8ca5-401088abaf39]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:49 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e Nov 05 08:28:49 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:49 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e" returned: 0 in 0.399s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:49 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e Nov 05 08:28:49 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:50 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3926ee27-4075-4d5e-ac1c-0d86f685549e" returned: 0 in 0.308s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "cinder-quobyte-3926ee27-4075-4d5e-ac1c-0d86f685549e" released by "delete_volume" :: held 0.767s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Created reservations ['89f5e380-6b22-47f1-9eb1-a976804a7b41', '52dedfda-5363-4042-abb9-7634834ef2cb', 'eb89d48b-ea63-4afc-853e-f195a992c28d', '930fc657-2899-46dc-adbc-d65252ffb7a1'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (05efdd7f-cbe2-4eb5-ad20-6d8fd9371444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd6b165-cbe5-4ddb-a011-c6b92951c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd6b165-cbe5-4ddb-a011-c6b92951c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23707255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bdc869-82b0-4989-ac01-b6622f31b26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:50Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5fcd5-de98-4a69-9dec-406f36d1a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5fcd5-de98-4a69-9dec-406f36d1a119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12680132-2e63-4edf-addb-21fdf29037fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12680132-2e63-4edf-addb-21fdf29037fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bdc869-82b0-4989-ac01-b6622f31b26d', 'volume_name': 'volume-92bdc869-82b0-4989-ac01-b6622f31b26d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e88df5-2a55-4f41-b0a6-69946333299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e88df5-2a55-4f41-b0a6-69946333299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58499a1c-c3c9-4009-a16e-03fedca4e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Volume 92bdc869-82b0-4989-ac01-b6622f31b26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bdc869-82b0-4989-ac01-b6622f31b26d', 'volume_size': 1} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23707255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bdc869-82b0-4989-ac01-b6622f31b26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:50Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Creating volume 92bdc869-82b0-4989-ac01-b6622f31b26d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:50 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:50 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d 1073741824 Nov 05 08:28:50 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:50 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:28:50 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:51 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.301s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Deleted volume successfully. Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c03092e3-7bf7-468e-aab9-11f2b0e7045e tempest-AttachVolumeShelveTestJSON-750476140 None] Lock "cinder-3926ee27-4075-4d5e-ac1c-0d86f685549e-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:51 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d 1073741824" returned: 0 in 0.619s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:51 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d Nov 05 08:28:51 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:51 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58499a1c-c3c9-4009-a16e-03fedca4e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bdc869-82b0-4989-ac01-b6622f31b26d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec25dcde-a2fe-4dd2-9567-170769d006f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:51 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Volume volume-92bdc869-82b0-4989-ac01-b6622f31b26d (92bdc869-82b0-4989-ac01-b6622f31b26d): created successfully Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec25dcde-a2fe-4dd2-9567-170769d006f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (05efdd7f-cbe2-4eb5-ad20-6d8fd9371444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f252851a-05e0-4475-8255-747e3733bbc7 tempest-VolumesListAdminTestJSON-1075927933 None] Created volume successfully. Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (1d8021d4-ce26-471f-be81-aec6d786f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5f28e-56ac-4610-84a4-ee1c2f5b3088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5f28e-56ac-4610-84a4-ee1c2f5b3088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944698419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3bd719-e174-402b-b60e-0d44cd24c0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:53Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ed9772-d1ee-48a3-9bf3-f55a7c948f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ed9772-d1ee-48a3-9bf3-f55a7c948f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc7a55-e3a3-41f3-971e-9bde04687b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc7a55-e3a3-41f3-971e-9bde04687b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3bd719-e174-402b-b60e-0d44cd24c0d5', 'volume_name': 'volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b75454-3903-45a6-9f79-83a0b3a91116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b75454-3903-45a6-9f79-83a0b3a91116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149e3c5f-084f-42d8-95af-09374f9292ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:53 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Volume 6b3bd719-e174-402b-b60e-0d44cd24c0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5', 'volume_size': 1} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944698419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3bd719-e174-402b-b60e-0d44cd24c0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:53Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Creating volume 6b3bd719-e174-402b-b60e-0d44cd24c0d5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:53 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:53 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 1073741824 Nov 05 08:28:53 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:53 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 1073741824" returned: 0 in 0.530s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:53 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 Nov 05 08:28:53 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:54 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5" returned: 0 in 0.318s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149e3c5f-084f-42d8-95af-09374f9292ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4785c1cb-c462-4612-9236-0a77e580f38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Volume volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 (6b3bd719-e174-402b-b60e-0d44cd24c0d5): created successfully Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4785c1cb-c462-4612-9236-0a77e580f38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (1d8021d4-ce26-471f-be81-aec6d786f350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3097e9cc-cfe4-4564-96e5-954dff755546 tempest-VolumesListAdminTestJSON-1075927933 None] Created volume successfully. Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (6936cf4f-106f-4926-907a-9303d9447dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39eb3a2-e4f2-4429-ba48-31c54a8debd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39eb3a2-e4f2-4429-ba48-31c54a8debd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-121995276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3e4d9-48a7-4fff-a7f0-071f057408f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:56Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ba3d2c-0a9d-47a8-a21e-c7274b2d5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ba3d2c-0a9d-47a8-a21e-c7274b2d5a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f228f9b-ea8c-4689-859f-c07776708975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f228f9b-ea8c-4689-859f-c07776708975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce3e4d9-48a7-4fff-a7f0-071f057408f1', 'volume_name': 'volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1873fa61-7636-4e6e-a5fa-d330e8a28887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1873fa61-7636-4e6e-a5fa-d330e8a28887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f938d31-fa03-4dc9-a393-5a84653a341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Volume 3ce3e4d9-48a7-4fff-a7f0-071f057408f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1', 'volume_size': 1} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-121995276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3e4d9-48a7-4fff-a7f0-071f057408f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f429191214f8c8915d9f48da424bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:56Z,use_quota=True,user_id='c8c1e890304a4c7ab801658e297618f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Creating volume 3ce3e4d9-48a7-4fff-a7f0-071f057408f1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:56 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:56 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 1073741824 Nov 05 08:28:56 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:57 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 1073741824" returned: 0 in 0.738s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:57 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 Nov 05 08:28:57 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:57 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" returned: 0 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f938d31-fa03-4dc9-a393-5a84653a341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf0d34-0a83-40f5-9bb3-ba34be3fa8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Volume volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 (3ce3e4d9-48a7-4fff-a7f0-071f057408f1): created successfully Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf0d34-0a83-40f5-9bb3-ba34be3fa8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Flow 'volume_create_manager' (6936cf4f-106f-4926-907a-9303d9447dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0347b912-01ec-4afc-ab03-78c0d3e7fe3f tempest-VolumesListAdminTestJSON-1075927933 None] Created volume successfully. Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (09b096b4-5fd7-4e68-87ab-01dc6aa173c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e3260f-44dc-445b-860e-c75d7e48200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e3260f-44dc-445b-860e-c75d7e48200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1261308802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df2c62-283f-4642-8cd5-099b60c77ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:59Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cee3e11-024b-40d5-abbd-3d9565dfcd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cee3e11-024b-40d5-abbd-3d9565dfcd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14869e25-4f32-4e54-b139-9d38892074b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14869e25-4f32-4e54-b139-9d38892074b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39df2c62-283f-4642-8cd5-099b60c77ee8', 'volume_name': 'volume-39df2c62-283f-4642-8cd5-099b60c77ee8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dfbba3-5099-43be-a65b-7ce02f62ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dfbba3-5099-43be-a65b-7ce02f62ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170b3b07-b6bb-442b-ae7f-f4318c3d8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Volume 39df2c62-283f-4642-8cd5-099b60c77ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39df2c62-283f-4642-8cd5-099b60c77ee8', 'volume_size': 1} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1261308802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df2c62-283f-4642-8cd5-099b60c77ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:59Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Creating volume 39df2c62-283f-4642-8cd5-099b60c77ee8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:59 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:59 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 1073741824 Nov 05 08:28:59 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Flow 'volume_create_manager' (d82e2d20-ed25-4e70-aeb3-2768d3ae987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c912f68-05f5-4c45-b20e-7d866985ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c912f68-05f5-4c45-b20e-7d866985ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbaa1d1-57b9-42a5-8d72-296126a1cb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba9e0a67ca541ae87ac9e3bcfac3ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:59Z,use_quota=True,user_id='c8e6be4baedc49389452d58149e67af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04422b-ea1f-4ff7-85df-91837a05cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04422b-ea1f-4ff7-85df-91837a05cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5d92b6-92ab-4ade-b13c-ec8da9034efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5d92b6-92ab-4ade-b13c-ec8da9034efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fbaa1d1-57b9-42a5-8d72-296126a1cb98', 'volume_name': 'volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f0307-c4b3-4e1c-89e0-6e2bae067881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f0307-c4b3-4e1c-89e0-6e2bae067881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20826003-31c7-4fa5-8497-f656fe946373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Volume 0fbaa1d1-57b9-42a5-8d72-296126a1cb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98', 'volume_size': 1} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:59 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 1073741824" returned: 0 in 0.554s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:59 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 Nov 05 08:28:59 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:00 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbaa1d1-57b9-42a5-8d72-296126a1cb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba9e0a67ca541ae87ac9e3bcfac3ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:59Z,use_quota=True,user_id='c8e6be4baedc49389452d58149e67af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Creating volume 0fbaa1d1-57b9-42a5-8d72-296126a1cb98 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:00 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170b3b07-b6bb-442b-ae7f-f4318c3d8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39df2c62-283f-4642-8cd5-099b60c77ee8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3dcd1-2ac0-4faa-80a0-6b384f81445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:00 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 1073741824 Nov 05 08:29:00 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Volume volume-39df2c62-283f-4642-8cd5-099b60c77ee8 (39df2c62-283f-4642-8cd5-099b60c77ee8): created successfully Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3dcd1-2ac0-4faa-80a0-6b384f81445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (09b096b4-5fd7-4e68-87ab-01dc6aa173c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ddb1f5fa-32e9-43c1-8aa7-6badaf0423ec tempest-AttachVolumeNegativeTest-1576733215 None] Created volume successfully. Nov 05 08:29:00 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 1073741824" returned: 0 in 0.554s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:00 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 Nov 05 08:29:00 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:01 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20826003-31c7-4fa5-8497-f656fe946373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6aefb3-f23d-42a5-be9a-b9f2062ce354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:01 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Volume volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 (0fbaa1d1-57b9-42a5-8d72-296126a1cb98): created successfully Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6aefb3-f23d-42a5-be9a-b9f2062ce354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Flow 'volume_create_manager' (d82e2d20-ed25-4e70-aeb3-2768d3ae987c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-19c8f13a-6b6b-4cae-9699-d954c36fbd98 tempest-VolumesListAdminTestJSON-1141735876 None] Created volume successfully. Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Acquiring lock "cinder-0fbaa1d1-57b9-42a5-8d72-296126a1cb98-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "cinder-0fbaa1d1-57b9-42a5-8d72-296126a1cb98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Acquiring lock "cinder-quobyte-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "cinder-quobyte-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" acquired by "delete_volume" :: waited 0.043s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20d3d9-46c8-4e82-8bf8-0e316f58afd6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-3ce3e4d9-48a7-4fff-a7f0-071f057408f1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-3ce3e4d9-48a7-4fff-a7f0-071f057408f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-quobyte-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:02 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 Nov 05 08:29:02 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2632d3c3-ef28-47ae-b1fe-3b852176c9b7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 Nov 05 08:29:02 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dd7bb463-5e49-44d9-b452-cba4edf7cd76 req-12c8d010-5110-4d2a-8e7c-d9e28d89bc63 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dd7bb463-5e49-44d9-b452-cba4edf7cd76 req-12c8d010-5110-4d2a-8e7c-d9e28d89bc63 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dd7bb463-5e49-44d9-b452-cba4edf7cd76 req-12c8d010-5110-4d2a-8e7c-d9e28d89bc63 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-dd7bb463-5e49-44d9-b452-cba4edf7cd76 req-12c8d010-5110-4d2a-8e7c-d9e28d89bc63 tempest-AttachVolumeNegativeTest-1576733215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-39df2c62-283f-4642-8cd5-099b60c77ee8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f0b1d2c-0c91-4e27-8ce5-34427aa89cc1', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:29:02 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" returned: 0 in 0.598s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98 Nov 05 08:29:02 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-dd7bb463-5e49-44d9-b452-cba4edf7cd76 req-12c8d010-5110-4d2a-8e7c-d9e28d89bc63 tempest-AttachVolumeNegativeTest-1576733215 None] attachment_update completed successfully. Nov 05 08:29:02 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" returned: 0 in 0.637s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1 Nov 05 08:29:02 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" returned: 0 in 0.366s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "cinder-quobyte-0fbaa1d1-57b9-42a5-8d72-296126a1cb98" released by "delete_volume" :: held 1.060s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:02 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Created reservations ['1996e847-6333-4d4e-a22d-f83762290893', '7e2063bd-df79-4b9b-864c-abb6c89863af', '8b218217-72b4-457d-b007-437986438828', '3eeb9672-4a50-4c94-aaab-811fe47e991f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:03 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:03 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:03 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" returned: 0 in 0.441s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-3ce3e4d9-48a7-4fff-a7f0-071f057408f1" released by "delete_volume" :: held 1.158s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Created reservations ['5a2a1a57-8911-4ab6-a505-5442b8511cac', '6bcc8761-883c-4c75-9fd0-e25cc0ec6a01', 'dcf006cc-55e3-4209-952e-2c0a17f3ec6a', '009318e9-8490-4d72-92ff-5a0e3a104b72'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:03 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.454s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:03 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:03 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Deleted volume successfully. Nov 05 08:29:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-524eb3e4-3177-4a9f-a1b9-da14b3541851 tempest-VolumesListAdminTestJSON-1141735876 None] Lock "cinder-0fbaa1d1-57b9-42a5-8d72-296126a1cb98-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:04 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.563s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Deleted volume successfully. Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4b74d0cf-98ea-4bd1-aa27-20aaf68a265d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-3ce3e4d9-48a7-4fff-a7f0-071f057408f1-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-6b3bd719-e174-402b-b60e-0d44cd24c0d5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-6b3bd719-e174-402b-b60e-0d44cd24c0d5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-quobyte-6b3bd719-e174-402b-b60e-0d44cd24c0d5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-6b3bd719-e174-402b-b60e-0d44cd24c0d5" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a19cf-2702-4682-b1d2-835049b07f0a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 Nov 05 08:29:04 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:05 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5" returned: 0 in 0.642s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5 Nov 05 08:29:05 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-0f627f88-f6d9-4183-a752-aedc2cb3f007 req-dee86f36-5ee0-46b1-8614-08a6c44db849 tempest-AttachVolumeNegativeTest-1576733215 None] Terminate volume connection completed successfully. Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-0f627f88-f6d9-4183-a752-aedc2cb3f007 req-dee86f36-5ee0-46b1-8614-08a6c44db849 tempest-AttachVolumeNegativeTest-1576733215 None] Deleting attachment 9f0b1d2c-0c91-4e27-8ce5-34427aa89cc1. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:29:05 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b3bd719-e174-402b-b60e-0d44cd24c0d5" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-6b3bd719-e174-402b-b60e-0d44cd24c0d5" released by "delete_volume" :: held 1.138s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Created reservations ['5e58d877-5809-4af6-a46c-855b9c9e1d43', '39efd2ea-7138-4af8-970c-20fb17cc81ec', 'f35e4c61-a93f-4b48-95a0-7cb9398f3283', 'ef132266-f80f-4792-9b92-05669320e47e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:05 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:06 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.368s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:06 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Deleted volume successfully. Nov 05 08:29:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-63787655-0e31-470e-9128-38d2e3eb8e5d tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-6b3bd719-e174-402b-b60e-0d44cd24c0d5-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-92bdc869-82b0-4989-ac01-b6622f31b26d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-92bdc869-82b0-4989-ac01-b6622f31b26d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "cinder-quobyte-92bdc869-82b0-4989-ac01-b6622f31b26d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-92bdc869-82b0-4989-ac01-b6622f31b26d" acquired by "delete_volume" :: waited 0.061s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c05e04d-bde8-4d03-9d03-a20c3c8a3765]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:07 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d Nov 05 08:29:07 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:07 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d" returned: 0 in 0.584s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:07 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d Nov 05 08:29:07 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:08 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-92bdc869-82b0-4989-ac01-b6622f31b26d" returned: 0 in 0.362s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-quobyte-92bdc869-82b0-4989-ac01-b6622f31b26d" released by "delete_volume" :: held 1.039s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Created reservations ['b9209065-0021-40c0-ac72-ca752baf8b98', '2ff41cb9-fd72-4025-8c45-778e5f48c4cc', '63bb82a2-66a6-4ff1-8799-25cca032642b', 'd0bbd047-97de-4a56-ae0c-470ad6ff0d1f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:08 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:08 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-13dc21c5-5a05-4c03-9dbe-e015cf8595f7 tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-109291168: creating Nov 05 08:29:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-13dc21c5-5a05-4c03-9dbe-e015cf8595f7 tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-109291168: created successfully Nov 05 08:29:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-13dc21c5-5a05-4c03-9dbe-e015cf8595f7 tempest-GroupSnapshotsTest-1136274376 None] Create group completed successfully. Nov 05 08:29:08 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Deleted volume successfully. Nov 05 08:29:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-debf0175-0ffe-460d-81b6-64aae9d52cd6 tempest-VolumesListAdminTestJSON-1075927933 None] Lock "cinder-92bdc869-82b0-4989-ac01-b6622f31b26d-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (6d5b53a0-1dae-445a-888f-9acfaefedf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f582fa3-116f-44dd-84fc-5713b2984d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f582fa3-116f-44dd-84fc-5713b2984d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988643611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8728cf-f874-4e31-a9be-b985210cf50a,host='devstack@QuobyteHD#QuobyteHD',id=445e395b-22e7-4c7a-bacf-80ce8a80b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:11Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a109855a-0250-47bf-b15c-8000e4acafe9),volume_type_id=a109855a-0250-47bf-b15c-8000e4acafe9)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34880ac2-1da8-4f31-a1a4-2ab56a0adfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34880ac2-1da8-4f31-a1a4-2ab56a0adfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a1d037-8c31-42b5-ac9c-8d287a2b1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a1d037-8c31-42b5-ac9c-8d287a2b1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445e395b-22e7-4c7a-bacf-80ce8a80b46f', 'volume_name': 'volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699606eb-7742-4ebc-9c9f-ac39a4e1880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699606eb-7742-4ebc-9c9f-ac39a4e1880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d93d7-d1d3-43c4-b2b3-08c674e098ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Volume 445e395b-22e7-4c7a-bacf-80ce8a80b46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f', 'volume_size': 1} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db8728cf-f874-4e31-a9be-b985210cf50a,created_at=2026-11-05T07:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988643611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8728cf-f874-4e31-a9be-b985210cf50a,host='devstack@QuobyteHD#QuobyteHD',id=445e395b-22e7-4c7a-bacf-80ce8a80b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:11Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a109855a-0250-47bf-b15c-8000e4acafe9),volume_type_id=a109855a-0250-47bf-b15c-8000e4acafe9)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Creating volume 445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:10 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:10 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f 1073741824 Nov 05 08:29:10 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:11 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f 1073741824" returned: 0 in 0.667s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:11 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:11 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:11 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.362s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d93d7-d1d3-43c4-b2b3-08c674e098ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e90d732-6a8a-44aa-b867-c2b84073dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:12 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Volume volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f (445e395b-22e7-4c7a-bacf-80ce8a80b46f): created successfully Nov 05 08:29:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e90d732-6a8a-44aa-b867-c2b84073dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (6d5b53a0-1dae-445a-888f-9acfaefedf13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b11846aa-12cb-45fd-9899-5481b14abf67 tempest-GroupSnapshotsTest-1136274376 None] Created volume successfully. Nov 05 08:29:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] GroupSnapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: creating. Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Group snapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: creating. {{(pid=87101) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Creating offline snapshot 1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b of volume 445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2008153-adad-4943-a4e3-7b383037bac4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:13 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:13 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:14 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.466s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:14 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b 1G Nov 05 08:29:14 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:14 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b 1G" returned: 0 in 0.657s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:14 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:14 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:15 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.443s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:15 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:15 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:15 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info Nov 05 08:29:15 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:15 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info" returned: 0 in 0.384s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:15 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info Nov 05 08:29:15 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:16 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.info" returned: 0 in 0.308s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ac01053b-de4e-4c86-b16f-6316ee7efc49 tempest-GroupSnapshotsTest-1136274376 None] group_snapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: created successfully Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b-939b5deb-68f5-405e-a182-f45873bf25ba" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b-939b5deb-68f5-405e-a182-f45873bf25ba" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Creating volume 939b5deb-68f5-405e-a182-f45873bf25ba from snapshot 1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] snapshot: 1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b, volume: 939b5deb-68f5-405e-a182-f45873bf25ba, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[60daecb7-75b1-4b1e-b6d2-08b4333c2e82]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:19 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:19 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:20 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.786s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Flow 'volume_create_manager' (1e69ee31-a13a-4db9-b44d-4f0719944131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7da3da-958d-4dd1-86d7-c116795b24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cb008c-ed1f-444a-b27b-1e4354d1ed2e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7da3da-958d-4dd1-86d7-c116795b24e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159225088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88974e3-f64a-479b-9845-25c7b40350aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfdb065a1d4375ad01690b270498da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:20Z,use_quota=True,user_id='848901bdd8c6490895128aae5afbdcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aafbb89-b501-4705-81d1-bc8b13b199a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aafbb89-b501-4705-81d1-bc8b13b199a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163280b3-144d-4dd1-bf87-7d6d77470f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163280b3-144d-4dd1-bf87-7d6d77470f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88974e3-f64a-479b-9845-25c7b40350aa', 'volume_name': 'volume-b88974e3-f64a-479b-9845-25c7b40350aa', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d892a6-ca73-4f30-bbad-0964aadf9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d892a6-ca73-4f30-bbad-0964aadf9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12ce6cb-88bc-44c9-9588-cc7397a5e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Volume b88974e3-f64a-479b-9845-25c7b40350aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88974e3-f64a-479b-9845-25c7b40350aa', 'volume_size': 1} Nov 05 08:29:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:20 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:20 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:21 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.883s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:29:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:29:21 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:29:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:21 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba Nov 05 08:29:21 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:30 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=66,cinder:INSERT=14,cinder:UPDATE=67,cinder:DELETE=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:29:30 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=53,cinder:INSERT=17,cinder:UPDATE=74,cinder:DELETE=9 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:29:33 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba" returned: 0 in 12.103s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f, size 1024.00 MB, duration 12.11 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:29:33 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Converted 1024.00 MB image at 84.58 MB/s Nov 05 08:29:33 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:33 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba Nov 05 08:29:33 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:33 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" released by "_copy_volume_from_snapshot" :: held 14.393s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b-939b5deb-68f5-405e-a182-f45873bf25ba" released by "_create_volume_from_snapshot" :: held 14.543s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.600s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.230s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159225088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88974e3-f64a-479b-9845-25c7b40350aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfdb065a1d4375ad01690b270498da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:20Z,use_quota=True,user_id='848901bdd8c6490895128aae5afbdcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Creating volume b88974e3-f64a-479b-9845-25c7b40350aa {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:33 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:33 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa 1073741824 Nov 05 08:29:33 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dc698884-6d67-4eaf-8618-a3daf2f2b8ee tempest-GroupSnapshotsTest-1136274376 None] Create group from source-snapshot-ea6fac86-eeb4-481a-8d64-f3caa85c7e21 completed successfully. Nov 05 08:29:34 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa 1073741824" returned: 0 in 0.567s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:34 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa Nov 05 08:29:34 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:34 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12ce6cb-88bc-44c9-9588-cc7397a5e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88974e3-f64a-479b-9845-25c7b40350aa', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38de528-c9f4-4a2d-8ac8-2401414e181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Volume volume-b88974e3-f64a-479b-9845-25c7b40350aa (b88974e3-f64a-479b-9845-25c7b40350aa): created successfully Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38de528-c9f4-4a2d-8ac8-2401414e181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Flow 'volume_create_manager' (1e69ee31-a13a-4db9-b44d-4f0719944131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6a1d94a9-d9b0-4d5d-ab13-571ae2765125 tempest-VolumesTransfersTest-620052401 None] Created volume successfully. Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a26f70e-07e0-4a22-9456-525a60546ebe]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:35 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba Nov 05 08:29:35 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:35 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba" returned: 0 in 0.557s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:35 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba Nov 05 08:29:35 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:35 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-939b5deb-68f5-405e-a182-f45873bf25ba" returned: 0 in 0.279s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-939b5deb-68f5-405e-a182-f45873bf25ba" released by "delete_volume" :: held 0.922s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['02044621-36bc-4793-8ac1-3de6a6cbe82f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:36 devstack cinder-volume[87101]: WARNING cinder.quota [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1427484091 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1427484091, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:29:36 devstack cinder-volume[87101]: WARNING cinder.quota [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1427484091 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1427484091, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['c3dd5e1c-1236-412c-9da9-04f8c1d091c0', '9d87d6b9-5976-4410-b331-e2ec2cc623fb', '0300c9ae-9fc5-492e-8c16-a3c71952d1e8', 'b16fe838-fe4f-42d2-9bbd-8437d85f6821'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5cb064fd-688c-476d-97b7-8f95f716e932 tempest-VolumesTransfersTest-1798462461 None] Transfer volume completed successfully. Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:36 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:36 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:36 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3e24d236-4bfe-49af-8e17-a7fa752419aa tempest-GroupSnapshotsTest-1136274376 None] Delete group completed successfully. Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Acquiring lock "cinder-b88974e3-f64a-479b-9845-25c7b40350aa-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "cinder-b88974e3-f64a-479b-9845-25c7b40350aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Acquiring lock "cinder-quobyte-b88974e3-f64a-479b-9845-25c7b40350aa" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "cinder-quobyte-b88974e3-f64a-479b-9845-25c7b40350aa" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[389062f4-27cf-4584-8b95-bb0b1f370c19]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:36 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa Nov 05 08:29:36 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:37 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa" returned: 0 in 0.411s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:37 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa Nov 05 08:29:37 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:37 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] group_snapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: deleting Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] group_snapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: deleting {{(pid=87101) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Deleting offline snapshot 1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b of volume 445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] snapshot_file for this snap is: volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[af29246d-8614-4f31-8794-f6719fcc7492]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:37 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b88974e3-f64a-479b-9845-25c7b40350aa" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "cinder-quobyte-b88974e3-f64a-479b-9845-25c7b40350aa" released by "delete_volume" :: held 0.774s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Created reservations ['1ee06100-c33f-4beb-ae7c-e864a813bd17', '0cb05e59-60bd-44d3-8eee-27fb905e342a', '6657a98e-935a-410f-a04a-175b31252cea', '813313c3-6420-4cf2-a3f1-370a7eecd95d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:37 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:37 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:37 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:37 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:37 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395de01-c106-4c8a-a9f1-8a9a99637e77]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:38 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.325s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Deleted volume successfully. Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf94f603-04ce-45d6-beb6-afe78d92ec8b tempest-VolumesTransfersTest-202678339 None] Lock "cinder-b88974e3-f64a-479b-9845-25c7b40350aa-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:38 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:38 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Flow 'volume_create_manager' (dace292c-6c24-44d1-a787-ef9e392e05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6133d430-d880-4a4c-9349-ce3255638795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6133d430-d880-4a4c-9349-ce3255638795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1684634665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38303513-e4b2-478c-8ed7-6ba88e6637f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfdb065a1d4375ad01690b270498da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:38Z,use_quota=True,user_id='848901bdd8c6490895128aae5afbdcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8005718c-b021-43be-b2e1-a2f05484444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8005718c-b021-43be-b2e1-a2f05484444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1350097f-ef33-410e-8393-ca82cb851b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:38 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1350097f-ef33-410e-8393-ca82cb851b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38303513-e4b2-478c-8ed7-6ba88e6637f0', 'volume_name': 'volume-38303513-e4b2-478c-8ed7-6ba88e6637f0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8fd92e-2c74-4c86-bfdb-c95e564cdf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8fd92e-2c74-4c86-bfdb-c95e564cdf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8b2f65-6782-4d56-b3d5-9953aa4cc382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:38 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Volume 38303513-e4b2-478c-8ed7-6ba88e6637f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38303513-e4b2-478c-8ed7-6ba88e6637f0', 'volume_size': 1} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1684634665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38303513-e4b2-478c-8ed7-6ba88e6637f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfdb065a1d4375ad01690b270498da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:38Z,use_quota=True,user_id='848901bdd8c6490895128aae5afbdcef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Creating volume 38303513-e4b2-478c-8ed7-6ba88e6637f0 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:38 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.625s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:38 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 1073741824 Nov 05 08:29:38 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:38 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:38 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:39 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.354s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:39 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b Nov 05 08:29:39 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:39 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 1073741824" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:39 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 Nov 05 08:29:39 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:39 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f.1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1bb4fdf8-68f7-495d-9a58-ca17c5d2ba9b" released by "_delete_snapshot" :: held 1.832s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" released by "delete_snapshot" :: held 1.884s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:39 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:39 devstack cinder-volume[87101]: WARNING cinder.quota [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1427484091 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1427484091, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8b2f65-6782-4d56-b3d5-9953aa4cc382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38303513-e4b2-478c-8ed7-6ba88e6637f0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83554bfb-cbc7-4bb7-b396-34d7efed5c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['a9c364d8-01e5-4b63-baf8-46fc7b662b6b', 'dc3c2631-b5a0-4f12-ad09-27a2e4ce2fdd', 'c4e6ad70-638c-47d6-a8bc-1d3d2c3aec12', '409bc05a-53a1-4079-809d-6d39a84b6824'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Volume volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 (38303513-e4b2-478c-8ed7-6ba88e6637f0): created successfully Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83554bfb-cbc7-4bb7-b396-34d7efed5c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Flow 'volume_create_manager' (dace292c-6c24-44d1-a787-ef9e392e05ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-19487ff6-1e55-4443-97d3-635892d158d4 tempest-VolumesTransfersTest-620052401 None] Created volume successfully. Nov 05 08:29:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-245826ad-7a02-48db-9ff3-f33829ae9cff tempest-GroupSnapshotsTest-1136274376 None] group_snapshot ea6fac86-eeb4-481a-8d64-f3caa85c7e21: deleted successfully Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[77018728-448b-4db5-b8f8-3ecd1bfe95a4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:40 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:40 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:40 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:40 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f Nov 05 08:29:40 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:40 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-445e395b-22e7-4c7a-bacf-80ce8a80b46f" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-445e395b-22e7-4c7a-bacf-80ce8a80b46f" released by "delete_volume" :: held 0.813s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:40 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['c355561b-3f66-4281-adb0-331e5813dc38'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:40 devstack cinder-volume[87101]: WARNING cinder.db.api [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1427484091'] Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['3127b379-89c4-4c83-a5e8-bf504eedfc14', 'a8b92bec-ed3e-4f9c-aef0-940f722479fa', '2feaa5e1-197d-4f20-8ab6-7cfb948d278d', '77d62d80-08b6-4155-88e3-f545b7fca99b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Acquiring lock "cinder-38303513-e4b2-478c-8ed7-6ba88e6637f0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "cinder-38303513-e4b2-478c-8ed7-6ba88e6637f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Acquiring lock "cinder-quobyte-38303513-e4b2-478c-8ed7-6ba88e6637f0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:41 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:41 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "cinder-quobyte-38303513-e4b2-478c-8ed7-6ba88e6637f0" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d75eee-de68-484c-81a3-1da39d1ac500]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:41 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 Nov 05 08:29:41 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:41 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.473s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b6a7a011-749e-498b-85db-e0edf3862182 tempest-GroupSnapshotsTest-1136274376 None] Delete group completed successfully. Nov 05 08:29:41 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0" returned: 0 in 0.571s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:41 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0 Nov 05 08:29:41 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b0b00b0d-46cd-486b-8c79-6aa3413b3aec tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-1157266726: creating Nov 05 08:29:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b0b00b0d-46cd-486b-8c79-6aa3413b3aec tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-1157266726: created successfully Nov 05 08:29:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b0b00b0d-46cd-486b-8c79-6aa3413b3aec tempest-GroupSnapshotsTest-1136274376 None] Create group completed successfully. Nov 05 08:29:42 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-38303513-e4b2-478c-8ed7-6ba88e6637f0" returned: 0 in 0.363s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "cinder-quobyte-38303513-e4b2-478c-8ed7-6ba88e6637f0" released by "delete_volume" :: held 1.003s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Created reservations ['23782462-fd53-4f6c-bc85-2c1816693521', '1c21c36d-c3ec-4f94-9d10-62767f3ea073', '60e2c533-cd0e-4eca-9615-e27c982e2098', 'b07bbb2c-4997-4c7f-b933-0445af070959'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:42 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:42 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:42 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Deleted volume successfully. Nov 05 08:29:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f21c6528-1ab2-4824-8ca9-b766c5c24449 tempest-VolumesTransfersTest-202678339 None] Lock "cinder-38303513-e4b2-478c-8ed7-6ba88e6637f0-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (157609bf-b78f-4240-b8af-87fe786af14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a05de6-a13c-4079-a6ed-dc5fca446e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a05de6-a13c-4079-a6ed-dc5fca446e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-691203767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9832a81d-362d-43b5-a652-3e700b4798c4,host='devstack@QuobyteHD#QuobyteHD',id=97b6e174-8d56-4abf-95d9-69224f3e34e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:44Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f624e92-a655-4d47-93ed-86a607debb38),volume_type_id=3f624e92-a655-4d47-93ed-86a607debb38)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5861f322-6e0e-409a-abf4-6c99cbc0b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5861f322-6e0e-409a-abf4-6c99cbc0b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4114d57d-706f-4e6a-a15c-df8bf5dbf86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4114d57d-706f-4e6a-a15c-df8bf5dbf86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b6e174-8d56-4abf-95d9-69224f3e34e3', 'volume_name': 'volume-97b6e174-8d56-4abf-95d9-69224f3e34e3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd49c3b9-924e-4c79-8f2e-e8895b1f2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd49c3b9-924e-4c79-8f2e-e8895b1f2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3cab8e-3c2a-41ef-a460-d4abe03824ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Volume 97b6e174-8d56-4abf-95d9-69224f3e34e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b6e174-8d56-4abf-95d9-69224f3e34e3', 'volume_size': 1} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9832a81d-362d-43b5-a652-3e700b4798c4,created_at=2026-11-05T07:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-691203767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9832a81d-362d-43b5-a652-3e700b4798c4,host='devstack@QuobyteHD#QuobyteHD',id=97b6e174-8d56-4abf-95d9-69224f3e34e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:44Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f624e92-a655-4d47-93ed-86a607debb38),volume_type_id=3f624e92-a655-4d47-93ed-86a607debb38)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Creating volume 97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:43 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:43 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 1073741824 Nov 05 08:29:43 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:44 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 1073741824" returned: 0 in 0.525s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:44 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 Nov 05 08:29:44 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:44 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3" returned: 0 in 0.279s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3cab8e-3c2a-41ef-a460-d4abe03824ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b6e174-8d56-4abf-95d9-69224f3e34e3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7978d52d-4139-49b8-a75c-531be1671130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Volume volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 (97b6e174-8d56-4abf-95d9-69224f3e34e3): created successfully Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7978d52d-4139-49b8-a75c-531be1671130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (157609bf-b78f-4240-b8af-87fe786af14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-01f9022f-06d5-4fe7-8858-95a80aa9cb9d tempest-GroupSnapshotsTest-1136274376 None] Created volume successfully. Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Flow 'volume_create_manager' (86259d8f-0304-4ed9-a2b8-a17367738b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31565d38-5260-403a-909d-0b3e1338590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31565d38-5260-403a-909d-0b3e1338590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2063884987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f2c128-21e8-443f-ba7e-280a3e984791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c10b70d1b4856a6df532b5009e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:45Z,use_quota=True,user_id='04384dd691a54f17b038f1d3adf618c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b067f14-e80e-489a-8260-979e55dd085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b067f14-e80e-489a-8260-979e55dd085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e0eb7-e0b9-4483-8962-a72e0bb45ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e0eb7-e0b9-4483-8962-a72e0bb45ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f2c128-21e8-443f-ba7e-280a3e984791', 'volume_name': 'volume-57f2c128-21e8-443f-ba7e-280a3e984791', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3cd6f0-34f5-4051-8545-2bc91b6d3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3cd6f0-34f5-4051-8545-2bc91b6d3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ccbb2e-d1db-4663-862a-83c2cb73e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Volume 57f2c128-21e8-443f-ba7e-280a3e984791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f2c128-21e8-443f-ba7e-280a3e984791', 'volume_size': 1} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2063884987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f2c128-21e8-443f-ba7e-280a3e984791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c10b70d1b4856a6df532b5009e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:45Z,use_quota=True,user_id='04384dd691a54f17b038f1d3adf618c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Creating volume 57f2c128-21e8-443f-ba7e-280a3e984791 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:45 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:45 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 1073741824 Nov 05 08:29:45 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (a4be08ae-0123-4694-b027-c0b75faec70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b2a06-bc07-48a9-a545-4524070dd977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b2a06-bc07-48a9-a545-4524070dd977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473402639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9832a81d-362d-43b5-a652-3e700b4798c4,host='devstack@QuobyteHD#QuobyteHD',id=58252740-d664-4059-8ef0-eb5dcf448f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:46Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f624e92-a655-4d47-93ed-86a607debb38),volume_type_id=3f624e92-a655-4d47-93ed-86a607debb38)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e1d9ae-504a-4a88-bace-a7c4f7d30b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e1d9ae-504a-4a88-bace-a7c4f7d30b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c819f5-cfdd-4c64-b734-7b5c7524250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c819f5-cfdd-4c64-b734-7b5c7524250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58252740-d664-4059-8ef0-eb5dcf448f53', 'volume_name': 'volume-58252740-d664-4059-8ef0-eb5dcf448f53', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8789c997-97d9-4e6b-a4d6-b5f5e8864f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8789c997-97d9-4e6b-a4d6-b5f5e8864f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d6259e-b1f1-46a6-a5c3-77212c0d71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Volume 58252740-d664-4059-8ef0-eb5dcf448f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58252740-d664-4059-8ef0-eb5dcf448f53', 'volume_size': 1} Nov 05 08:29:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:46 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 1073741824" returned: 0 in 0.513s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:46 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 Nov 05 08:29:46 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:46 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791" returned: 0 in 0.304s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9832a81d-362d-43b5-a652-3e700b4798c4,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473402639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9832a81d-362d-43b5-a652-3e700b4798c4,host='devstack@QuobyteHD#QuobyteHD',id=58252740-d664-4059-8ef0-eb5dcf448f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:46Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f624e92-a655-4d47-93ed-86a607debb38),volume_type_id=3f624e92-a655-4d47-93ed-86a607debb38)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Creating volume 58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:46 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:46 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 1073741824 Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ccbb2e-d1db-4663-862a-83c2cb73e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f2c128-21e8-443f-ba7e-280a3e984791', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:46 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a486fc-9893-44d9-9b34-c0673401af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Volume volume-57f2c128-21e8-443f-ba7e-280a3e984791 (57f2c128-21e8-443f-ba7e-280a3e984791): created successfully Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a486fc-9893-44d9-9b34-c0673401af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Flow 'volume_create_manager' (86259d8f-0304-4ed9-a2b8-a17367738b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-598290c2-105f-462f-b4e3-32d8ae8bc573 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Created volume successfully. Nov 05 08:29:47 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 1073741824" returned: 0 in 0.472s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:47 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 Nov 05 08:29:47 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:47 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d6259e-b1f1-46a6-a5c3-77212c0d71c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58252740-d664-4059-8ef0-eb5dcf448f53', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6bc57-fd08-4332-aa1d-61c133ccd284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Volume volume-58252740-d664-4059-8ef0-eb5dcf448f53 (58252740-d664-4059-8ef0-eb5dcf448f53): created successfully Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6bc57-fd08-4332-aa1d-61c133ccd284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (a4be08ae-0123-4694-b027-c0b75faec70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-165303dd-862b-4e16-ba38-9149e1f0bf16 tempest-GroupSnapshotsTest-1136274376 None] Created volume successfully. Nov 05 08:29:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-658e4fb9-b6e1-40cd-b170-87d305a79d9c tempest-GroupSnapshotsTest-1136274376 None] Update group completed successfully. Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:48 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:48 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-fae6e588-7070-41e2-94ae-bf0f40a63e0f req-7c8bd47f-4bb3-42d0-9b6c-9f0f8ecbee5f tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-fae6e588-7070-41e2-94ae-bf0f40a63e0f req-7c8bd47f-4bb3-42d0-9b6c-9f0f8ecbee5f tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-fae6e588-7070-41e2-94ae-bf0f40a63e0f req-7c8bd47f-4bb3-42d0-9b6c-9f0f8ecbee5f tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-fae6e588-7070-41e2-94ae-bf0f40a63e0f req-7c8bd47f-4bb3-42d0-9b6c-9f0f8ecbee5f tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-57f2c128-21e8-443f-ba7e-280a3e984791', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4361046-a820-41e3-af99-209da60edf4d', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:29:48 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:29:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:29:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-fae6e588-7070-41e2-94ae-bf0f40a63e0f req-7c8bd47f-4bb3-42d0-9b6c-9f0f8ecbee5f tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] attachment_update completed successfully. Nov 05 08:29:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1d4e8b02-26f9-4f57-8447-9c0eeeeb4ad3 tempest-GroupSnapshotsTest-1136274376 None] Update group completed successfully. Nov 05 08:29:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-86972fc5-3ef0-472f-95a9-48a8d4b39aa2 tempest-GroupSnapshotsTest-1136274376 None] Update group completed successfully. Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Flow 'volume_create_manager' (d94187cc-8370-4385-ace5-8a75256557c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90428372-8e57-4cd0-b34c-e43b23fd953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90428372-8e57-4cd0-b34c-e43b23fd953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-236962299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4d560-f5fb-46fc-9076-a78bc30c4aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca7a4b17a7490492b56da13055aae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:52Z,use_quota=True,user_id='cc9190e08f5a4146801bbfbee6264272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8b9b48-8351-464a-aef1-c20683144ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8b9b48-8351-464a-aef1-c20683144ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9311d1c9-984b-4602-b039-18ada7dec047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9311d1c9-984b-4602-b039-18ada7dec047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e4d560-f5fb-46fc-9076-a78bc30c4aaf', 'volume_name': 'volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac53da5b-f264-445c-842f-3565977ad928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac53da5b-f264-445c-842f-3565977ad928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6486ac69-bcac-41d7-ac2c-d016d08e009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Volume 57e4d560-f5fb-46fc-9076-a78bc30c4aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf', 'volume_size': 1} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-236962299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4d560-f5fb-46fc-9076-a78bc30c4aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca7a4b17a7490492b56da13055aae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:52Z,use_quota=True,user_id='cc9190e08f5a4146801bbfbee6264272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Creating volume 57e4d560-f5fb-46fc-9076-a78bc30c4aaf {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:52 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:52 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf 1073741824 Nov 05 08:29:52 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-36f1eebc-6a6b-43e1-8c04-812b5be9c481 tempest-GroupSnapshotsTest-1136274376 None] Update group completed successfully. Nov 05 08:29:52 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf 1073741824" returned: 0 in 0.500s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:52 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf Nov 05 08:29:52 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-5527a699-39fa-44b9-9c23-70db6c700fc5 req-5f6a069b-f202-4c95-bb3d-ef9b11334e2d tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Terminate volume connection completed successfully. Nov 05 08:29:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-5527a699-39fa-44b9-9c23-70db6c700fc5 req-5f6a069b-f202-4c95-bb3d-ef9b11334e2d tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Deleting attachment d4361046-a820-41e3-af99-209da60edf4d. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:29:53 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" returned: 0 in 0.330s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6486ac69-bcac-41d7-ac2c-d016d08e009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4adcaad-8315-43e2-8777-c6fb5f62ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:53 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Volume volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf (57e4d560-f5fb-46fc-9076-a78bc30c4aaf): created successfully Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4adcaad-8315-43e2-8777-c6fb5f62ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Flow 'volume_create_manager' (d94187cc-8370-4385-ace5-8a75256557c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f0fd07e3-ed39-42a1-ad43-f3ab4e943cac tempest-VolumesTransfersV355Test-1802804744 None] Created volume successfully. Nov 05 08:29:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] GroupSnapshot def8b12d-b2b1-4e14-a381-36500a9d830c: creating. Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Group snapshot def8b12d-b2b1-4e14-a381-36500a9d830c: creating. {{(pid=87101) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Creating offline snapshot ba0990a1-80f4-4bab-8e58-566afda6480e of volume 97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[307eebe8-1507-45e9-84f9-4a0226f00dfd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "cinder-57f2c128-21e8-443f-ba7e-280a3e984791-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "cinder-57f2c128-21e8-443f-ba7e-280a3e984791-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:53 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 Nov 05 08:29:53 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "cinder-quobyte-57f2c128-21e8-443f-ba7e-280a3e984791" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "cinder-quobyte-57f2c128-21e8-443f-ba7e-280a3e984791" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a4a2b-698d-4a69-a41f-62aa88d0db39]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:53 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 Nov 05 08:29:53 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:54 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3" returned: 0 in 0.412s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:54 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e 1G Nov 05 08:29:54 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:54 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791" returned: 0 in 0.381s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:54 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791 Nov 05 08:29:54 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:54 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57f2c128-21e8-443f-ba7e-280a3e984791" returned: 0 in 0.298s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "cinder-quobyte-57f2c128-21e8-443f-ba7e-280a3e984791" released by "delete_volume" :: held 0.725s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:54 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e 1G" returned: 0 in 0.464s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:54 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e Nov 05 08:29:54 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Created reservations ['3a9fefd0-7115-4c0d-b04c-494e2c1ac7c6', '0bd716da-372b-42cf-96fe-ec4488949475', 'db38346d-f1f9-4355-a562-526703514e82', '72353a59-453d-43ba-b162-46b424457b4c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:54 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:54 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-98cd4e54-3945-4f10-95c7-2fe0113fa9db tempest-VolumesTransfersV355Test-371744383 None] Transfer volume completed successfully. Nov 05 08:29:54 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e" returned: 0 in 0.398s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:54 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:55 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e Nov 05 08:29:55 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:55 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.359s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Deleted volume successfully. Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-3d3d6234-8497-40b7-9273-ca39d3565162 tempest-TestServerVolumeAttachScenarioOldVersion-904319767 None] Lock "cinder-57f2c128-21e8-443f-ba7e-280a3e984791-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:55 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:55 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info Nov 05 08:29:55 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "cinder-57e4d560-f5fb-46fc-9076-a78bc30c4aaf-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-57e4d560-f5fb-46fc-9076-a78bc30c4aaf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "cinder-quobyte-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-quobyte-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" acquired by "delete_volume" :: waited 0.068s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d372b81-c8f3-4065-a026-242477ad10d1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info" returned: 0 in 0.587s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info Nov 05 08:29:56 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf Nov 05 08:29:56 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (e9440e38-ca05-405a-8b7a-6f3a8ae1ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e052fd2b-e7ae-443a-a3a4-dcc47cbdd973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e052fd2b-e7ae-443a-a3a4-dcc47cbdd973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835221739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cace66-fe90-4ace-92d4-61c0ce16ee60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:56Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bbe25-c215-4207-a3e1-02a4fedd0582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bbe25-c215-4207-a3e1-02a4fedd0582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3d2d44-5917-4f8c-925f-09935d0aa9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3d2d44-5917-4f8c-925f-09935d0aa9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cace66-fe90-4ace-92d4-61c0ce16ee60', 'volume_name': 'volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d080931c-8f50-440c-9d8c-484ed893171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d080931c-8f50-440c-9d8c-484ed893171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8120a0a0-e360-490a-82af-3f0aa7e15b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Volume f5cace66-fe90-4ace-92d4-61c0ce16ee60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60', 'volume_size': 1} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:56 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.info" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:56 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Creating offline snapshot f3f268f3-d80e-4c32-b470-32b7dd161bac of volume 58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:56 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf Nov 05 08:29:56 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5128c6ce-ad9f-4e34-987b-cd2e02d37264]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 Nov 05 08:29:56 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-quobyte-57e4d560-f5fb-46fc-9076-a78bc30c4aaf" released by "delete_volume" :: held 0.984s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Created reservations ['d9e419f5-0332-41fc-a626-455f7673163b', '074c2124-3736-4dca-b66f-24eec12db142', '894a46cc-6c5e-4f2b-b26e-d19a80188bbd', '7a06fb4a-2afe-44a2-851d-e8d87a8bb9a8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53" returned: 0 in 0.508s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:29:57 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac 1G Nov 05 08:29:57 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.340s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Deleted volume successfully. Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bcdb10a7-4e4b-4641-b525-5dfae368ccde tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-57e4d560-f5fb-46fc-9076-a78bc30c4aaf-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:57 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac 1G" returned: 0 in 0.556s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58252740-d664-4059-8ef0-eb5dcf448f53 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58252740-d664-4059-8ef0-eb5dcf448f53 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac Nov 05 08:29:57 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58252740-d664-4059-8ef0-eb5dcf448f53 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac Nov 05 08:29:57 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:58 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info Nov 05 08:29:58 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:58 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info" returned: 0 in 0.386s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:58 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info Nov 05 08:29:58 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Flow 'volume_create_manager' (00bc6cf9-be8c-4df0-9515-ffb09fbe6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e4122a-029d-406b-aa8a-a196608aa014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e4122a-029d-406b-aa8a-a196608aa014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2115727805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da9698d-eb97-48e3-94d7-1ab195fa2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca7a4b17a7490492b56da13055aae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:59Z,use_quota=True,user_id='cc9190e08f5a4146801bbfbee6264272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db5b63-a959-47b6-8251-9f062a258441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db5b63-a959-47b6-8251-9f062a258441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67a90b5-0f2d-4fc5-ab76-d54d24a5d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67a90b5-0f2d-4fc5-ab76-d54d24a5d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da9698d-eb97-48e3-94d7-1ab195fa2af9', 'volume_name': 'volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710d733f-6406-4594-b5b7-ddd304936cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710d733f-6406-4594-b5b7-ddd304936cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fe504f-659e-495a-9b84-84b66b607f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Volume 9da9698d-eb97-48e3-94d7-1ab195fa2af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9', 'volume_size': 1} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:58 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.info" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835221739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cace66-fe90-4ace-92d4-61c0ce16ee60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3304acfc7b85472b99ecac35937951f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:56Z,use_quota=True,user_id='7f7f9033c2ac4d05babbadb271872282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Creating volume f5cace66-fe90-4ace-92d4-61c0ce16ee60 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:58 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 1073741824 Nov 05 08:29:58 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c45c94d8-afc8-474e-869b-b8debf2affce tempest-GroupSnapshotsTest-1136274376 None] group_snapshot def8b12d-b2b1-4e14-a381-36500a9d830c: created successfully Nov 05 08:29:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] group_snapshot def8b12d-b2b1-4e14-a381-36500a9d830c: deleting Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] group_snapshot def8b12d-b2b1-4e14-a381-36500a9d830c: deleting {{(pid=87101) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-ba0990a1-80f4-4bab-8e58-566afda6480e" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-ba0990a1-80f4-4bab-8e58-566afda6480e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Deleting offline snapshot ba0990a1-80f4-4bab-8e58-566afda6480e of volume 97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] snapshot_file for this snap is: volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5879cb-aa97-4def-8b76-fa94ac26d85b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:59 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 1073741824" returned: 0 in 0.576s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:59 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e Nov 05 08:29:59 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:59 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 Nov 05 08:29:59 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:59 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e" returned: 0 in 0.453s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97b6e174-8d56-4abf-95d9-69224f3e34e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:59 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60" returned: 0 in 0.332s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2115727805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da9698d-eb97-48e3-94d7-1ab195fa2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ca7a4b17a7490492b56da13055aae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:59Z,use_quota=True,user_id='cc9190e08f5a4146801bbfbee6264272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Creating volume 9da9698d-eb97-48e3-94d7-1ab195fa2af9 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:59 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc172f7f-e0d0-4702-ba97-ba406ce8fd14]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:59 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 1073741824 Nov 05 08:29:59 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8120a0a0-e360-490a-82af-3f0aa7e15b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f43f3-e95d-4a0a-9ce0-aff4a5559cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Volume volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 (f5cace66-fe90-4ace-92d4-61c0ce16ee60): created successfully Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f43f3-e95d-4a0a-9ce0-aff4a5559cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Flow 'volume_create_manager' (e9440e38-ca05-405a-8b7a-6f3a8ae1ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8a3499e5-57aa-477b-b40f-9ccdd7d2d805 tempest-AttachVolumeNegativeTest-1576733215 None] Created volume successfully. Nov 05 08:30:00 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 Nov 05 08:30:00 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:00 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e Nov 05 08:30:00 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 1073741824" returned: 0 in 0.558s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:00 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 Nov 05 08:30:00 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e" returned: 0 in 0.457s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:00 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9" returned: 0 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:00 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e Nov 05 08:30:00 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fe504f-659e-495a-9b84-84b66b607f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244f8cf3-f965-410b-9774-c1dcaa8057ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Volume volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 (9da9698d-eb97-48e3-94d7-1ab195fa2af9): created successfully Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244f8cf3-f965-410b-9774-c1dcaa8057ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Flow 'volume_create_manager' (00bc6cf9-be8c-4df0-9515-ffb09fbe6c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2c9e006c-522e-4c88-9a0c-35d18237e35b tempest-VolumesTransfersV355Test-1802804744 None] Created volume successfully. Nov 05 08:30:01 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3.ba0990a1-80f4-4bab-8e58-566afda6480e" returned: 0 in 0.330s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-ba0990a1-80f4-4bab-8e58-566afda6480e" released by "_delete_snapshot" :: held 1.861s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" released by "delete_snapshot" :: held 1.889s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-f3f268f3-d80e-4c32-b470-32b7dd161bac" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-f3f268f3-d80e-4c32-b470-32b7dd161bac" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Deleting offline snapshot f3f268f3-d80e-4c32-b470-32b7dd161bac of volume 58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] snapshot_file for this snap is: volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66254df-29ef-4a43-b24d-f8453b422c94]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:01 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac Nov 05 08:30:01 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-b2dbf13a-3416-4b9b-8bcf-a7bab6de134a req-4d41ea3d-a691-4e33-947a-eaf82a0c0152 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-b2dbf13a-3416-4b9b-8bcf-a7bab6de134a req-4d41ea3d-a691-4e33-947a-eaf82a0c0152 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-b2dbf13a-3416-4b9b-8bcf-a7bab6de134a req-4d41ea3d-a691-4e33-947a-eaf82a0c0152 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-b2dbf13a-3416-4b9b-8bcf-a7bab6de134a req-4d41ea3d-a691-4e33-947a-eaf82a0c0152 tempest-AttachVolumeNegativeTest-1576733215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '515c33f3-0102-42ce-9c07-b6f2ec5cf50d', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:30:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-b2dbf13a-3416-4b9b-8bcf-a7bab6de134a req-4d41ea3d-a691-4e33-947a-eaf82a0c0152 tempest-AttachVolumeNegativeTest-1576733215 None] attachment_update completed successfully. Nov 05 08:30:01 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac" returned: 0 in 0.432s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58252740-d664-4059-8ef0-eb5dcf448f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[75542276-a617-408f-b8bc-8005e34f70de]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:01 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 Nov 05 08:30:01 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "cinder-9da9698d-eb97-48e3-94d7-1ab195fa2af9-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-9da9698d-eb97-48e3-94d7-1ab195fa2af9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "cinder-quobyte-9da9698d-eb97-48e3-94d7-1ab195fa2af9" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-quobyte-9da9698d-eb97-48e3-94d7-1ab195fa2af9" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:02 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53" returned: 0 in 0.696s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065755d-a9f0-4274-ab8a-6787df720b89]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac Nov 05 08:30:02 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 Nov 05 08:30:02 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac Nov 05 08:30:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9 Nov 05 08:30:02 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53.f3f268f3-d80e-4c32-b470-32b7dd161bac" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da9698d-eb97-48e3-94d7-1ab195fa2af9" returned: 0 in 0.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-f3f268f3-d80e-4c32-b470-32b7dd161bac" released by "_delete_snapshot" :: held 2.008s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-quobyte-9da9698d-eb97-48e3-94d7-1ab195fa2af9" released by "delete_volume" :: held 0.798s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" released by "delete_snapshot" :: held 2.048s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Created reservations ['1db40099-5e14-4f9f-acee-2bc2eb10c7a6', 'f80a6e1a-30ed-4ea9-aa72-1090b2cbbebb', '500a2179-6715-42a6-a02e-06846ab9f1cc', '819af4c5-5671-4a25-a1bf-e73d4d4996d6'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:03 devstack cinder-volume[87101]: WARNING cinder.quota [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-88045888 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-88045888, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:03 devstack cinder-volume[87101]: WARNING cinder.quota [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-88045888 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-88045888, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['d24317ff-56ca-4d9a-958c-cb867ea3bb4c', '7555b215-107a-4658-9b46-db93ee9f6525', '522f9c9d-4962-4fcc-9d81-af28443178b1', '8f4cdd9f-002f-4f3c-ba0b-832adc194067'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:03 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['d69aeef8-23ca-4ea4-a90a-678b627eed32', '714323f6-d588-4738-9381-1c044ac59689', '9b525334-89f5-4e74-9cf3-86ed41ac3953', '7b39f120-2f20-454b-bc9e-075c41dba9ec'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9c2a7313-1bbe-4ccb-942a-e1634773c197 tempest-GroupSnapshotsTest-1136274376 None] group_snapshot def8b12d-b2b1-4e14-a381-36500a9d830c: deleted successfully Nov 05 08:30:03 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.439s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Deleted volume successfully. Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13986c03-0f0a-404f-bf92-87a76bd5eb9f tempest-VolumesTransfersV355Test-65518452 None] Lock "cinder-9da9698d-eb97-48e3-94d7-1ab195fa2af9-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-65110180-32f0-4c52-9fd4-447cb1e22790 req-7add3f70-eea2-46fb-a8eb-7b0d1c800b96 tempest-AttachVolumeNegativeTest-1576733215 None] Terminate volume connection completed successfully. Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-65110180-32f0-4c52-9fd4-447cb1e22790 req-7add3f70-eea2-46fb-a8eb-7b0d1c800b96 tempest-AttachVolumeNegativeTest-1576733215 None] Deleting attachment 515c33f3-0102-42ce-9c07-b6f2ec5cf50d. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d3214-92e7-4afd-8c25-50d525627d60]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:04 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 Nov 05 08:30:04 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:05 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53" returned: 0 in 0.510s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:05 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53 Nov 05 08:30:05 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:05 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-58252740-d664-4059-8ef0-eb5dcf448f53" returned: 0 in 0.404s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-58252740-d664-4059-8ef0-eb5dcf448f53" released by "delete_volume" :: held 1.066s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff2580-1dc8-4b81-af47-b35fe8f50f46]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:06 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 Nov 05 08:30:06 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3" returned: 0 in 0.544s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:06 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3 Nov 05 08:30:06 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-97b6e174-8d56-4abf-95d9-69224f3e34e3" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-97b6e174-8d56-4abf-95d9-69224f3e34e3" released by "delete_volume" :: held 1.054s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['20e6a76e-2c0a-4b0a-8382-2ac60333ff1f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:06 devstack cinder-volume[87101]: WARNING cinder.quota [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-88045888 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-88045888, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['6833f69f-0fdc-4050-a4a7-f126854b313d', '66900d03-a527-4ba3-a5eb-bd34d2cc2521', 'ce194780-4b65-4b2e-94e7-d81fb6df69a4', 'a5d9533a-d254-4d91-8ade-dbbd24e7050e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['bbc767f5-6d52-4e4e-8802-70d2380924da', '2fbf6100-0b38-48d5-a857-36ddc55e20ac', '39171ec5-8dfc-48ed-9d7f-bb52dcbf95c1', '85c6ee6e-67d4-4e35-a7c3-cf017d8ef038'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:07 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:07 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:07 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:07 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e120e133-d72f-4c65-b8ef-649e9d2ebdd7 tempest-GroupSnapshotsTest-1136274376 None] Delete group completed successfully. Nov 05 08:30:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-df7a49fd-88fe-4038-8ac4-638127926157 tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-617037226: creating Nov 05 08:30:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-df7a49fd-88fe-4038-8ac4-638127926157 tempest-GroupSnapshotsTest-1136274376 None] Group tempest-GroupSnapshotsTest-Group-617037226: created successfully Nov 05 08:30:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-df7a49fd-88fe-4038-8ac4-638127926157 tempest-GroupSnapshotsTest-1136274376 None] Create group completed successfully. Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (da82900b-90ad-4902-80a4-569d82740d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d99deda-61e7-4682-9660-e8a02df1e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d99deda-61e7-4682-9660-e8a02df1e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595898120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7329708-ab5e-4382-ad31-735c1b612aea,host='devstack@QuobyteHD#QuobyteHD',id=acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:10Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9e24443-466d-41a0-bcdd-11274b44590b),volume_type_id=b9e24443-466d-41a0-bcdd-11274b44590b)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30d0eb-7039-46dc-9e80-471cd1689fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30d0eb-7039-46dc-9e80-471cd1689fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac27752e-f35b-40a9-aaf5-97bfee6b54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac27752e-f35b-40a9-aaf5-97bfee6b54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d', 'volume_name': 'volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b79cffd-a17c-422a-ba0a-5ebcd3d8209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b79cffd-a17c-422a-ba0a-5ebcd3d8209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95b27c6-7f4a-4ce3-8457-3e6c3b8c1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Volume acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d', 'volume_size': 1} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7329708-ab5e-4382-ad31-735c1b612aea,created_at=2026-11-05T07:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595898120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7329708-ab5e-4382-ad31-735c1b612aea,host='devstack@QuobyteHD#QuobyteHD',id=acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a317262b97432ab0327dc53a03b952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:10Z,use_quota=True,user_id='e105b8bad38644f39441a52f942a86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9e24443-466d-41a0-bcdd-11274b44590b),volume_type_id=b9e24443-466d-41a0-bcdd-11274b44590b)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Creating volume acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:09 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:09 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d 1073741824 Nov 05 08:30:09 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:10 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d 1073741824" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:10 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d Nov 05 08:30:10 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:10 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95b27c6-7f4a-4ce3-8457-3e6c3b8c1897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e17b8-1642-47c2-b952-9902a92443ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Volume volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d (acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d): created successfully Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e17b8-1642-47c2-b952-9902a92443ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Flow 'volume_create_manager' (da82900b-90ad-4902-80a4-569d82740d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dd2c8ce4-2bc4-4ce4-911b-01a88badc436 tempest-GroupSnapshotsTest-1136274376 None] Created volume successfully. Nov 05 08:30:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] GroupSnapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: creating. Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Group snapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: creating. {{(pid=87101) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Creating offline snapshot 1444c358-fd77-4496-bd31-488b0f573391 of volume acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[72206f5c-938c-42cb-a69e-c9f8ec118391]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-f5cace66-fe90-4ace-92d4-61c0ce16ee60-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-f5cace66-fe90-4ace-92d4-61c0ce16ee60-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-quobyte-f5cace66-fe90-4ace-92d4-61c0ce16ee60" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:11 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d Nov 05 08:30:11 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-f5cace66-fe90-4ace-92d4-61c0ce16ee60" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9259996-db34-4016-aedd-a1b166f84c12]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:11 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 Nov 05 08:30:11 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:11 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" returned: 0 in 0.529s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:12 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 1G Nov 05 08:30:12 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:12 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:12 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60 Nov 05 08:30:12 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:12 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5cace66-fe90-4ace-92d4-61c0ce16ee60" returned: 0 in 0.294s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-f5cace66-fe90-4ace-92d4-61c0ce16ee60" released by "delete_volume" :: held 0.829s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Created reservations ['79c172ca-5c3b-4e50-a30b-2d9382d3d970', '18759ed6-f4b4-46a9-9ce1-6750f1cf99f9', '2d7029df-0017-4f2b-a226-f045a670e0ae', '9ce8fdf5-75e0-43e0-bfa7-868c3a769e5e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:12 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 1G" returned: 0 in 0.626s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:12 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 Nov 05 08:30:12 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:12 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:12 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-39df2c62-283f-4642-8cd5-099b60c77ee8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-39df2c62-283f-4642-8cd5-099b60c77ee8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-quobyte-39df2c62-283f-4642-8cd5-099b60c77ee8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:13 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-39df2c62-283f-4642-8cd5-099b60c77ee8" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.396s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Deleted volume successfully. Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98b2de-72c0-4b47-9260-bf1832c39119]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:13 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391" returned: 0 in 0.469s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-35a64bb4-f9b3-43cc-9e49-551eb2c813e1 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-f5cace66-fe90-4ace-92d4-61c0ce16ee60-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:13 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 Nov 05 08:30:13 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:13 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 Nov 05 08:30:13 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:13 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391" returned: 0 in 0.332s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:13 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info Nov 05 08:30:13 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:13 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8" returned: 0 in 0.472s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:13 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8 Nov 05 08:30:13 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:13 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info" returned: 0 in 0.359s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:13 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info Nov 05 08:30:13 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:13 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-39df2c62-283f-4642-8cd5-099b60c77ee8" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-39df2c62-283f-4642-8cd5-099b60c77ee8" released by "delete_volume" :: held 0.870s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:13 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Created reservations ['4a2d6b96-352c-41f9-8398-5757e2fb40b7', 'a93ffa35-d03d-49dc-a1fb-7e0a624a3ff3', '440b24a1-3ea1-4225-bfa7-b795b700e849', '41660da1-255a-4f60-adde-dbf8e8702b4d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:14 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:14 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Flow 'volume_create_manager' (19f67853-0ee1-427b-8be6-53b84953391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555823b-c5b1-400f-bed8-c96a3295f10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:14 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555823b-c5b1-400f-bed8-c96a3295f10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1777833510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb2e1a-53c2-4731-801e-196d44e45a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcf6dc8b10041e48d9dab624572245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:14Z,use_quota=True,user_id='1c24e671134e46f4bbb348d8840f5046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ffc48-e053-47ad-b0e3-27b75e0e846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ffc48-e053-47ad-b0e3-27b75e0e846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db291960-611a-419f-b765-a82a4f6b0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db291960-611a-419f-b765-a82a4f6b0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bb2e1a-53c2-4731-801e-196d44e45a48', 'volume_name': 'volume-d2bb2e1a-53c2-4731-801e-196d44e45a48', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d964d50-f2d6-4f0b-b336-04265154e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d964d50-f2d6-4f0b-b336-04265154e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc8154d-ecc6-4222-b75d-2c0b987cec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:14 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Volume d2bb2e1a-53c2-4731-801e-196d44e45a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bb2e1a-53c2-4731-801e-196d44e45a48', 'volume_size': 1} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.info" returned: 0 in 0.435s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1777833510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb2e1a-53c2-4731-801e-196d44e45a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcf6dc8b10041e48d9dab624572245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:14Z,use_quota=True,user_id='1c24e671134e46f4bbb348d8840f5046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Creating volume d2bb2e1a-53c2-4731-801e-196d44e45a48 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:14 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:14 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 1073741824 Nov 05 08:30:14 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:14 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Deleted volume successfully. Nov 05 08:30:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38b194f3-576b-4eba-aab4-ae2316ef69a8 tempest-GroupSnapshotsTest-1136274376 None] group_snapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: created successfully Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-dee89f44-4a17-4563-ae3a-bb7aa15342f8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9abda109-0613-47e2-9a59-e5455dd4b8e8 tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-39df2c62-283f-4642-8cd5-099b60c77ee8-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-dee89f44-4a17-4563-ae3a-bb7aa15342f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "cinder-quobyte-dee89f44-4a17-4563-ae3a-bb7aa15342f8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-dee89f44-4a17-4563-ae3a-bb7aa15342f8" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020eddf-f9c9-4985-9443-35d4db7f16eb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:14 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 Nov 05 08:30:14 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] group_snapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: deleting Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] group_snapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: deleting {{(pid=87101) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-1444c358-fd77-4496-bd31-488b0f573391" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:14 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 1073741824" returned: 0 in 0.646s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1444c358-fd77-4496-bd31-488b0f573391" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Deleting offline snapshot 1444c358-fd77-4496-bd31-488b0f573391 of volume acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] snapshot_file for this snap is: volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff2321-889d-4485-8341-a48f99197176]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 Nov 05 08:30:15 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:15 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8" returned: 0 in 0.539s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8 Nov 05 08:30:15 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:15 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 Nov 05 08:30:15 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:15 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc8154d-ecc6-4222-b75d-2c0b987cec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bb2e1a-53c2-4731-801e-196d44e45a48', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0e904-d84a-46a3-a391-b004c3d84cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Volume volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 (d2bb2e1a-53c2-4731-801e-196d44e45a48): created successfully Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0e904-d84a-46a3-a391-b004c3d84cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Flow 'volume_create_manager' (19f67853-0ee1-427b-8be6-53b84953391d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ceee85cf-cd88-4789-b616-c8364b23f828 tempest-VolumesNegativeTest-1477801633 None] Created volume successfully. Nov 05 08:30:15 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-dee89f44-4a17-4563-ae3a-bb7aa15342f8" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:15 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391" returned: 0 in 0.457s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-quobyte-dee89f44-4a17-4563-ae3a-bb7aa15342f8" released by "delete_volume" :: held 0.947s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f03baf-f23e-4b5e-bf88-c807432bb64a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Created reservations ['d8b3e6d1-73fd-4d43-be25-e878c72d2384', 'ff64585f-f58d-4bad-8e65-8aa7c6cebf6d', '4768edf2-eea6-4b9a-aadc-59acb8a7f600', '1fe17ea5-d106-45bc-99a0-da06f2d40ac9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:15 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d Nov 05 08:30:15 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:15 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:16 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" returned: 0 in 0.450s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:16 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Deleted volume successfully. Nov 05 08:30:16 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 Nov 05 08:30:16 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2a0c44aa-1b94-41d6-afd3-9338b262181d tempest-AttachVolumeNegativeTest-1576733215 None] Lock "cinder-dee89f44-4a17-4563-ae3a-bb7aa15342f8-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:16 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391" returned: 0 in 0.449s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:16 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391 Nov 05 08:30:16 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:16 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d.1444c358-fd77-4496-bd31-488b0f573391" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-1444c358-fd77-4496-bd31-488b0f573391" released by "_delete_snapshot" :: held 1.852s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" released by "delete_snapshot" :: held 1.901s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:16 devstack cinder-volume[87101]: WARNING cinder.quota [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1013437531 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1013437531, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:16 devstack cinder-volume[87101]: WARNING cinder.quota [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1013437531 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1013437531, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:16 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['3593a3d6-725d-4ad9-905b-9f36686d4e3f', 'ee092a91-e7f4-4654-a8fc-f163e2a258e7', '9cc8052f-6587-4ee7-9d21-1c5a546492d5', '6d64e6d1-2bce-47e5-8487-6047c2b125bf'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8f20cd60-2477-4aeb-bcbd-723dabacbe2c tempest-GroupSnapshotsTest-1136274376 None] group_snapshot 5dc80703-021d-4cf0-9442-31c201c85fa9: deleted successfully Nov 05 08:30:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:17 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e5b49-c271-493f-b6eb-b103f0ad3d02]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:17 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d Nov 05 08:30:17 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:18 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" returned: 0 in 0.474s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:18 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d Nov 05 08:30:18 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:18 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" returned: 0 in 0.374s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Lock "cinder-quobyte-acbd4eeb-ec27-4f2f-a1e0-1f13247f3a3d" released by "delete_volume" :: held 0.944s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['ca73e86d-e1e7-436b-adc1-31a5742df9c1'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:18 devstack cinder-volume[87101]: WARNING cinder.quota [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1013437531 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1013437531, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:18 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Created reservations ['62ad461b-b016-4a6a-b2a9-0412d5de5c88', '45b0b032-4a21-4591-9b80-34b61296aeca', '9b396685-0141-4a20-8587-bcecea0cc923', 'fe7cde6d-14ff-4ced-b0d3-61dbd219ff56'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:19 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:19 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:19 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:19 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ecddb711-2ea2-421d-985a-4cd5e86592ee tempest-GroupSnapshotsTest-1136274376 None] Delete group completed successfully. Nov 05 08:30:29 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=174,cinder:UPDATE=178,cinder:INSERT=42,cinder:DELETE=7 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:30:29 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=160,cinder:INSERT=44,cinder:UPDATE=194,cinder:DELETE=11 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Flow 'volume_create_manager' (663cdffb-5eb7-4610-8535-b0da9857dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26482e2a-6e84-431f-818e-0b7102cf3827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26482e2a-6e84-431f-818e-0b7102cf3827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1742086458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f9174-403d-4661-9838-6fd8cec56d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5dbfccae0f43bf9518460759bf6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:43Z,use_quota=True,user_id='6b7bab078c9b4ae885da713f0456ade1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593b3c2d-c42d-49be-828f-65ecb795fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593b3c2d-c42d-49be-828f-65ecb795fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888b92d4-4390-44bc-93e7-b35afefb7658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888b92d4-4390-44bc-93e7-b35afefb7658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28f9174-403d-4661-9838-6fd8cec56d23', 'volume_name': 'volume-d28f9174-403d-4661-9838-6fd8cec56d23', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9095fb-fe43-4e57-8729-62c460a27d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9095fb-fe43-4e57-8729-62c460a27d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0c9e7-c80c-4a94-b95a-060c18206370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Volume d28f9174-403d-4661-9838-6fd8cec56d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28f9174-403d-4661-9838-6fd8cec56d23', 'volume_size': 1} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1742086458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f9174-403d-4661-9838-6fd8cec56d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5dbfccae0f43bf9518460759bf6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:43Z,use_quota=True,user_id='6b7bab078c9b4ae885da713f0456ade1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Creating volume d28f9174-403d-4661-9838-6fd8cec56d23 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:43 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:43 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 1073741824 Nov 05 08:30:43 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:43 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 1073741824" returned: 0 in 0.658s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:44 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 Nov 05 08:30:44 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:44 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23" returned: 0 in 0.384s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0c9e7-c80c-4a94-b95a-060c18206370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28f9174-403d-4661-9838-6fd8cec56d23', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771289ee-c336-4041-a319-9b5b39b82ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Volume volume-d28f9174-403d-4661-9838-6fd8cec56d23 (d28f9174-403d-4661-9838-6fd8cec56d23): created successfully Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771289ee-c336-4041-a319-9b5b39b82ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Flow 'volume_create_manager' (663cdffb-5eb7-4610-8535-b0da9857dde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e593eaaf-390f-4a75-9e7f-2311419e8ee3 tempest-VolumeQuotasNegativeTestJSON-729798613 None] Created volume successfully. Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Acquiring lock "cinder-d2bb2e1a-53c2-4731-801e-196d44e45a48-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "cinder-d2bb2e1a-53c2-4731-801e-196d44e45a48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Acquiring lock "cinder-quobyte-d2bb2e1a-53c2-4731-801e-196d44e45a48" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "cinder-quobyte-d2bb2e1a-53c2-4731-801e-196d44e45a48" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[25835dd3-cfb7-400f-a047-e1643b7808ef]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:45 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 Nov 05 08:30:45 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:45 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48" returned: 0 in 0.584s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:45 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48 Nov 05 08:30:45 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Flow 'volume_create_manager' (b6d3d027-cbbe-465b-9e13-659814739044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb943c42-656a-4b6c-a49f-4ccbf7c6238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb943c42-656a-4b6c-a49f-4ccbf7c6238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1191898489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028f3a4e-e841-4043-8a75-7a248675d39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84aeb25942945fcb69118e5ec64064a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:46Z,use_quota=True,user_id='2a128b32eab3468587cf196ea74b6ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254dd119-4fca-4641-9f29-b442778c2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254dd119-4fca-4641-9f29-b442778c2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29138ac8-806d-4aa8-b853-a2ed185203b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29138ac8-806d-4aa8-b853-a2ed185203b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028f3a4e-e841-4043-8a75-7a248675d39f', 'volume_name': 'volume-028f3a4e-e841-4043-8a75-7a248675d39f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e150d69-e980-4b50-a232-885ad1adeacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e150d69-e980-4b50-a232-885ad1adeacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b4c373-0543-4c33-b3dd-7608db1a1298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume 028f3a4e-e841-4043-8a75-7a248675d39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028f3a4e-e841-4043-8a75-7a248675d39f', 'volume_size': 1} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1191898489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028f3a4e-e841-4043-8a75-7a248675d39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84aeb25942945fcb69118e5ec64064a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:46Z,use_quota=True,user_id='2a128b32eab3468587cf196ea74b6ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Creating volume 028f3a4e-e841-4043-8a75-7a248675d39f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:46 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:46 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f 1073741824 Nov 05 08:30:46 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:46 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d2bb2e1a-53c2-4731-801e-196d44e45a48" returned: 0 in 0.336s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "cinder-quobyte-d2bb2e1a-53c2-4731-801e-196d44e45a48" released by "delete_volume" :: held 0.990s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Created reservations ['991de3f1-14a7-45d5-8fee-72926b10b47c', '89439812-49ca-41a4-aca5-239fba819d73', 'a9813981-00b0-4b5f-8f10-5971be7c9b2d', 'cde43d18-940a-4994-948b-ced448bf8d46'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:46 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:46 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Flow 'volume_create_manager' (00f88d08-194f-4601-9efd-7b9b77dfdd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac09d13-f8d5-44ad-9645-d6462b2ce175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac09d13-f8d5-44ad-9645-d6462b2ce175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1749745970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2545abff-e3f2-4b70-8ace-4d2b8a1915b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84aeb25942945fcb69118e5ec64064a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:47Z,use_quota=True,user_id='2a128b32eab3468587cf196ea74b6ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3564cf3-cf96-4c35-bbc7-0556ef1f8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3564cf3-cf96-4c35-bbc7-0556ef1f8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cbacd8-0d21-4ae0-b1c4-12fcc1d816fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cbacd8-0d21-4ae0-b1c4-12fcc1d816fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2545abff-e3f2-4b70-8ace-4d2b8a1915b0', 'volume_name': 'volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b8c80b-6003-450d-b4c8-f511e2a23601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b8c80b-6003-450d-b4c8-f511e2a23601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed3131a-79f6-436f-b824-dca4ef5d7ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume 2545abff-e3f2-4b70-8ace-4d2b8a1915b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0', 'volume_size': 1} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:46 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f 1073741824" returned: 0 in 0.703s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:46 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Deleted volume successfully. Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e821f9e8-a5fa-46be-ba43-676a8ff862ed tempest-VolumesNegativeTest-1477801633 None] Lock "cinder-d2bb2e1a-53c2-4731-801e-196d44e45a48-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:47 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f Nov 05 08:30:47 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:47 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1749745970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2545abff-e3f2-4b70-8ace-4d2b8a1915b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84aeb25942945fcb69118e5ec64064a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:47Z,use_quota=True,user_id='2a128b32eab3468587cf196ea74b6ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Creating volume 2545abff-e3f2-4b70-8ace-4d2b8a1915b0 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:47 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b4c373-0543-4c33-b3dd-7608db1a1298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028f3a4e-e841-4043-8a75-7a248675d39f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:47 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 1073741824 Nov 05 08:30:47 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df8fc87-018d-402b-97c2-f744cff523ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume volume-028f3a4e-e841-4043-8a75-7a248675d39f (028f3a4e-e841-4043-8a75-7a248675d39f): created successfully Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df8fc87-018d-402b-97c2-f744cff523ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Flow 'volume_create_manager' (b6d3d027-cbbe-465b-9e13-659814739044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2b216159-8192-4979-9521-56847e603852 tempest-TestServerVolumeAttachmentScenario-51650833 None] Created volume successfully. Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Acquiring lock "cinder-d28f9174-403d-4661-9838-6fd8cec56d23-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "cinder-d28f9174-403d-4661-9838-6fd8cec56d23-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Acquiring lock "cinder-quobyte-d28f9174-403d-4661-9838-6fd8cec56d23" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "cinder-quobyte-d28f9174-403d-4661-9838-6fd8cec56d23" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98df37-faf5-4855-81ec-2f2aed62827c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:47 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 Nov 05 08:30:47 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:48 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 1073741824" returned: 0 in 0.734s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 Nov 05 08:30:48 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:48 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23" returned: 0 in 0.583s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23 Nov 05 08:30:48 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" returned: 0 in 0.458s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d28f9174-403d-4661-9838-6fd8cec56d23" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:48 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:48 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "cinder-quobyte-d28f9174-403d-4661-9838-6fd8cec56d23" released by "delete_volume" :: held 1.026s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed3131a-79f6-436f-b824-dca4ef5d7ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e5dcc9-7a46-4193-8318-547f3edf7b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Volume volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 (2545abff-e3f2-4b70-8ace-4d2b8a1915b0): created successfully Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e5dcc9-7a46-4193-8318-547f3edf7b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Flow 'volume_create_manager' (00f88d08-194f-4601-9efd-7b9b77dfdd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-40d695ba-031f-41b6-83e5-c6158963af03 tempest-TestServerVolumeAttachmentScenario-51650833 None] Created volume successfully. Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Created reservations ['9db75aa2-4db3-4b44-a9ac-314d19ced6c9', '3f018c65-fea2-4520-a24b-2b96ac70ca33', 'b803cd08-9ec9-4b53-97c2-d86b3386af57', 'f0c722b8-ee29-4251-b858-1c36d975e321'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:30:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:30:48 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:48 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:49 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Deleted volume successfully. Nov 05 08:30:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cc7c26a8-7b09-4622-818a-f80259ed936c tempest-VolumeQuotasNegativeTestJSON-729798613 None] Lock "cinder-d28f9174-403d-4661-9838-6fd8cec56d23-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Flow 'volume_create_manager' (6192436c-fb5d-46e1-aaf8-b3337905125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dbbda1-8bff-4ed8-a464-fc10ec432697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dbbda1-8bff-4ed8-a464-fc10ec432697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117141243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c7a825-51a4-482f-a4d6-80ae153a0cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93756460fcd34999bd0ba4557f3e458f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:51Z,use_quota=True,user_id='11fdc886d62e4a109f52a93bd3d445c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a04431-b04f-4242-a4d8-5a8aeb86bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a04431-b04f-4242-a4d8-5a8aeb86bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01181c9d-6dab-47e7-b83b-26c71af17b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01181c9d-6dab-47e7-b83b-26c71af17b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c7a825-51a4-482f-a4d6-80ae153a0cd4', 'volume_name': 'volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47bcf39-8950-4d16-9fc1-ebf92c1a95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47bcf39-8950-4d16-9fc1-ebf92c1a95b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de3ef3-e1b3-4764-9770-5f6eb16cabfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:51 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume 05c7a825-51a4-482f-a4d6-80ae153a0cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4', 'volume_size': 1} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117141243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c7a825-51a4-482f-a4d6-80ae153a0cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93756460fcd34999bd0ba4557f3e458f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:51Z,use_quota=True,user_id='11fdc886d62e4a109f52a93bd3d445c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Creating volume 05c7a825-51a4-482f-a4d6-80ae153a0cd4 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:51 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:51 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 1073741824 Nov 05 08:30:51 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:52 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 1073741824" returned: 0 in 0.609s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:52 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 Nov 05 08:30:52 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:52 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4" returned: 0 in 0.339s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de3ef3-e1b3-4764-9770-5f6eb16cabfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e90a727-75a1-4995-bdd9-f3252e04775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 (05c7a825-51a4-482f-a4d6-80ae153a0cd4): created successfully Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e90a727-75a1-4995-bdd9-f3252e04775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Flow 'volume_create_manager' (6192436c-fb5d-46e1-aaf8-b3337905125d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1fe9813d-5a76-4efa-9485-edc0c41b377a tempest-VolumeQuotasAdminTestJSON-585775952 None] Created volume successfully. Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "cinder-05c7a825-51a4-482f-a4d6-80ae153a0cd4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "cinder-05c7a825-51a4-482f-a4d6-80ae153a0cd4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "cinder-quobyte-05c7a825-51a4-482f-a4d6-80ae153a0cd4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "cinder-quobyte-05c7a825-51a4-482f-a4d6-80ae153a0cd4" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617ad54-b3d2-4ed0-8f99-1a4eefb5cc13]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:54 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 Nov 05 08:30:54 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:54 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4" returned: 0 in 0.501s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:54 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4 Nov 05 08:30:54 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:54 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-05c7a825-51a4-482f-a4d6-80ae153a0cd4" returned: 0 in 0.311s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "cinder-quobyte-05c7a825-51a4-482f-a4d6-80ae153a0cd4" released by "delete_volume" :: held 0.882s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Created reservations ['cef42259-c133-4873-a12e-cee9a39a68c0', 'bf1b00f8-e045-46a5-8115-93ca19e15b90', '8422ab00-1b0f-41ff-aa4f-f79e32193f6c', '7ad6ed37-fd4d-4df0-9546-e7273f26047e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:55 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:30:55 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:55 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Deleted volume successfully. Nov 05 08:30:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1977c7ed-cf08-4647-b073-9841303f4e86 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "cinder-05c7a825-51a4-482f-a4d6-80ae153a0cd4-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Flow 'volume_create_manager' (743a02df-721d-411e-88ee-879ece92b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a378578-4b44-4b70-878a-20e22cd07312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a378578-4b44-4b70-878a-20e22cd07312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2074640320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172533d5-c3cc-450d-bc63-11cb77c8478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93756460fcd34999bd0ba4557f3e458f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:57Z,use_quota=True,user_id='11fdc886d62e4a109f52a93bd3d445c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d13c25-a555-4ee1-b648-29658c16e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d13c25-a555-4ee1-b648-29658c16e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8bed90-4198-4582-98c8-03cf195c85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8bed90-4198-4582-98c8-03cf195c85d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172533d5-c3cc-450d-bc63-11cb77c8478e', 'volume_name': 'volume-172533d5-c3cc-450d-bc63-11cb77c8478e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eff6cf3-dad9-43d4-9fc1-3f7622ef0d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eff6cf3-dad9-43d4-9fc1-3f7622ef0d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba818e5-3dc9-435d-9086-abc396eeacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume 172533d5-c3cc-450d-bc63-11cb77c8478e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172533d5-c3cc-450d-bc63-11cb77c8478e', 'volume_size': 1} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2074640320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172533d5-c3cc-450d-bc63-11cb77c8478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93756460fcd34999bd0ba4557f3e458f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:57Z,use_quota=True,user_id='11fdc886d62e4a109f52a93bd3d445c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Creating volume 172533d5-c3cc-450d-bc63-11cb77c8478e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:57 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:57 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e 1073741824 Nov 05 08:30:57 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:57 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e 1073741824" returned: 0 in 0.950s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:58 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e Nov 05 08:30:58 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:58 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba818e5-3dc9-435d-9086-abc396eeacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172533d5-c3cc-450d-bc63-11cb77c8478e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e615152d-21d6-4eff-b018-f337a26ea79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Volume volume-172533d5-c3cc-450d-bc63-11cb77c8478e (172533d5-c3cc-450d-bc63-11cb77c8478e): created successfully Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e615152d-21d6-4eff-b018-f337a26ea79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Flow 'volume_create_manager' (743a02df-721d-411e-88ee-879ece92b683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3c182108-4386-4d56-863f-4fefaac8f685 tempest-VolumeQuotasAdminTestJSON-585775952 None] Created volume successfully. Nov 05 08:31:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b3f284e2-1301-470f-a9d4-084a10f11e8e tempest-VolumeQuotasAdminTestJSON-1450422868 None] Transfer volume completed successfully. Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Acquiring lock "cinder-172533d5-c3cc-450d-bc63-11cb77c8478e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "cinder-172533d5-c3cc-450d-bc63-11cb77c8478e-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Acquiring lock "cinder-quobyte-172533d5-c3cc-450d-bc63-11cb77c8478e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "cinder-quobyte-172533d5-c3cc-450d-bc63-11cb77c8478e" acquired by "delete_volume" :: waited 0.054s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b3199-8913-4d21-92ac-173f516477c2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:01 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e Nov 05 08:31:01 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:02 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e" returned: 0 in 0.641s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:02 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e Nov 05 08:31:02 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:02 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-172533d5-c3cc-450d-bc63-11cb77c8478e" returned: 0 in 0.712s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "cinder-quobyte-172533d5-c3cc-450d-bc63-11cb77c8478e" released by "delete_volume" :: held 1.450s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Created reservations ['0292a71f-2cbd-49e8-ba4d-cccd0c224b40', 'f997bac3-e0b3-4ed1-a9e2-317bcaa1fb81', 'e81efe13-6596-4247-9824-65b615238d7e', '23e77e42-ae12-49dc-9dd4-6de80ee674cd'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:03 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:03 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:03 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.316s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:03 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Deleted volume successfully. Nov 05 08:31:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7852814-e325-448e-b5a5-dc02c252c0f1 tempest-VolumeQuotasAdminTestJSON-685017707 None] Lock "cinder-172533d5-c3cc-450d-bc63-11cb77c8478e-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (da8fc5ea-6281-48ee-9b61-9b773c3a9aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c0d7ca-e056-49a2-a617-767fa78ee42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c0d7ca-e056-49a2-a617-767fa78ee42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801589928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd2349c-9526-4154-8586-b8595017da5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:09Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dae108-bcba-458f-a607-b8eab5b219c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dae108-bcba-458f-a607-b8eab5b219c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a956759-2f38-4f0b-919b-51ccd8e4fb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a956759-2f38-4f0b-919b-51ccd8e4fb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd2349c-9526-4154-8586-b8595017da5d', 'volume_name': 'volume-abd2349c-9526-4154-8586-b8595017da5d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cdb0d-d99e-4a2b-85bc-68caba30f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cdb0d-d99e-4a2b-85bc-68caba30f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e7659-4077-4e6d-8089-cd43219317af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Volume abd2349c-9526-4154-8586-b8595017da5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd2349c-9526-4154-8586-b8595017da5d', 'volume_size': 1} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801589928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd2349c-9526-4154-8586-b8595017da5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:09Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Creating volume abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:09 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:09 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d 1073741824 Nov 05 08:31:09 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:10 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d 1073741824" returned: 0 in 0.808s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:10 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d Nov 05 08:31:10 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:10 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e7659-4077-4e6d-8089-cd43219317af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd2349c-9526-4154-8586-b8595017da5d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e458bb00-3074-4f03-a489-10478a22efb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Volume volume-abd2349c-9526-4154-8586-b8595017da5d (abd2349c-9526-4154-8586-b8595017da5d): created successfully Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e458bb00-3074-4f03-a489-10478a22efb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (da8fc5ea-6281-48ee-9b61-9b773c3a9aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bf94a44d-d001-46c5-ae71-f04e95ce2225 tempest-VolumesSnapshotTestJSON-471597244 None] Created volume successfully. Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Creating offline snapshot 63e95d28-6740-46b3-8f56-b40c11cad559 of volume abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3769d-0be2-47b5-a36f-cf91cbbe680d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:12 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d Nov 05 08:31:12 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:12 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d" returned: 0 in 0.416s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:12 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 1G Nov 05 08:31:12 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 1G" returned: 0 in 0.506s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd2349c-9526-4154-8586-b8595017da5d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd2349c-9526-4154-8586-b8595017da5d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 Nov 05 08:31:13 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd2349c-9526-4154-8586-b8595017da5d -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 is being set with open permissions: ugo+rw Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 Nov 05 08:31:13 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info Nov 05 08:31:13 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info is being set with open permissions: ugo+rw Nov 05 08:31:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:14 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info Nov 05 08:31:14 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:14 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.info" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dea076e0-54a5-4388-9887-dbf90662768e tempest-VolumesSnapshotTestJSON-471597244 None] Create snapshot completed successfully Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-63e95d28-6740-46b3-8f56-b40c11cad559-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-63e95d28-6740-46b3-8f56-b40c11cad559-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-63e95d28-6740-46b3-8f56-b40c11cad559" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-63e95d28-6740-46b3-8f56-b40c11cad559" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Deleting offline snapshot 63e95d28-6740-46b3-8f56-b40c11cad559 of volume abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] snapshot_file for this snap is: volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b2bab7-eda7-4ff9-96f8-b7485bfc36e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:15 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 Nov 05 08:31:15 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd2349c-9526-4154-8586-b8595017da5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac82542-b5c7-4e18-8cc3-b42e21f92c0d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d Nov 05 08:31:16 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d" returned: 0 in 0.440s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 Nov 05 08:31:16 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559 Nov 05 08:31:16 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:17 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d.63e95d28-6740-46b3-8f56-b40c11cad559" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-63e95d28-6740-46b3-8f56-b40c11cad559" released by "_delete_snapshot" :: held 1.696s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" released by "delete_snapshot" :: held 1.730s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['a263921f-bb10-454c-b56a-5af8a54e3251', '523c9853-7668-4dbf-a22f-dcce6716c890', 'd4b5c223-c58a-4c0f-8ee2-da52e15b8008', '14988a3c-d0c6-4cf8-917f-db4849ac96e4'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Delete snapshot completed successfully. Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a97e99bb-fa7c-4e6f-b9bf-6b625b1c06cf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-63e95d28-6740-46b3-8f56-b40c11cad559-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Flow 'volume_create_manager' (0cf7787b-14e8-444c-8b69-aaf165e2575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32125ed9-ec9c-4f85-b61f-232450e05709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32125ed9-ec9c-4f85-b61f-232450e05709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1781943892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3dfa2b-422f-4be8-b634-1ffba7e65956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f9f7379ea4457e94a6492c61f2bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:17Z,use_quota=True,user_id='d5a493b4a62146439b69b2059ddb8650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3754ae-9d08-4c3a-b4e9-563c0d4cb3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3754ae-9d08-4c3a-b4e9-563c0d4cb3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a119bed-053f-4d09-a6cb-82d1807c27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a119bed-053f-4d09-a6cb-82d1807c27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3dfa2b-422f-4be8-b634-1ffba7e65956', 'volume_name': 'volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87122735-6417-4087-8b19-37a987faf90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87122735-6417-4087-8b19-37a987faf90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9e8ad-11b7-4448-bdaa-fd27c18bfc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Volume 2c3dfa2b-422f-4be8-b634-1ffba7e65956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956', 'volume_size': 1} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1781943892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3dfa2b-422f-4be8-b634-1ffba7e65956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f9f7379ea4457e94a6492c61f2bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:17Z,use_quota=True,user_id='d5a493b4a62146439b69b2059ddb8650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Creating volume 2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:17 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:17 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 1073741824 Nov 05 08:31:17 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 1073741824" returned: 0 in 0.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:18 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 Nov 05 08:31:18 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (dbb1e7cc-c29e-4ec3-93cc-822fcf762841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff34d192-f01c-4829-80c6-2cdaf37ff7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff34d192-f01c-4829-80c6-2cdaf37ff7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1051577127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da61759-7d34-4c27-af5b-0c85e3ad164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:18Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f88697f-5eee-46ff-9313-4a75d1b46870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f88697f-5eee-46ff-9313-4a75d1b46870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac518f9-1404-487d-bbc0-2910226d460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac518f9-1404-487d-bbc0-2910226d460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da61759-7d34-4c27-af5b-0c85e3ad164c', 'volume_name': 'volume-3da61759-7d34-4c27-af5b-0c85e3ad164c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee8fd71-b119-4261-be41-9ce28f44d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee8fd71-b119-4261-be41-9ce28f44d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae93f48-370a-4e0e-bc2d-c8c1d8c276e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Volume 3da61759-7d34-4c27-af5b-0c85e3ad164c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da61759-7d34-4c27-af5b-0c85e3ad164c', 'volume_size': 1} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:18 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956" returned: 0 in 0.339s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1051577127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da61759-7d34-4c27-af5b-0c85e3ad164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:18Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Creating volume 3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:18 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:18 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c 1073741824 Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9e8ad-11b7-4448-bdaa-fd27c18bfc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3829f6-9439-4495-a2fe-3ebc44db62c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Volume volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 (2c3dfa2b-422f-4be8-b634-1ffba7e65956): created successfully Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3829f6-9439-4495-a2fe-3ebc44db62c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Flow 'volume_create_manager' (0cf7787b-14e8-444c-8b69-aaf165e2575a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-802edab2-ea74-4aa7-b0b7-e8fa136ba024 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Created volume successfully. Nov 05 08:31:19 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c 1073741824" returned: 0 in 0.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:19 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:19 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:19 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae93f48-370a-4e0e-bc2d-c8c1d8c276e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da61759-7d34-4c27-af5b-0c85e3ad164c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda73909-0371-4f74-b510-0bf57aa33bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:19 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Volume volume-3da61759-7d34-4c27-af5b-0c85e3ad164c (3da61759-7d34-4c27-af5b-0c85e3ad164c): created successfully Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda73909-0371-4f74-b510-0bf57aa33bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (dbb1e7cc-c29e-4ec3-93cc-822fcf762841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c00beab3-351c-49f6-8e53-46e91f0248ef tempest-VolumesSnapshotTestJSON-471597244 None] Created volume successfully. Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Creating offline snapshot d229d66d-4eb0-4125-8bbb-125b8508b3e0 of volume 2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea429ad-d6d2-42b7-bc62-87ddfb097a8f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:20 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 Nov 05 08:31:20 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:20 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956" returned: 0 in 0.476s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:20 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 1G Nov 05 08:31:20 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:20 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 1G" returned: 0 in 0.453s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:20 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 Nov 05 08:31:20 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:21 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:21 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 is being set with open permissions: ugo+rw Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:21 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 Nov 05 08:31:21 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:21 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:21 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info Nov 05 08:31:21 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:21 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info" returned: 0 in 0.267s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:21 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info is being set with open permissions: ugo+rw Nov 05 08:31:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:21 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info Nov 05 08:31:21 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:22 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.info" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.435s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Creating offline snapshot 9186f5f3-55a2-47d1-829b-cb3c711bc2c8 of volume 3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-353746df-3498-4d9f-b8b7-8dd4a29b5931 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Create snapshot completed successfully Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4515c-b622-419a-aab4-4ae75da9a843]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:22 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:22 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:22 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.420s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:22 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 1G Nov 05 08:31:22 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:22 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 1G" returned: 0 in 0.448s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da61759-7d34-4c27-af5b-0c85e3ad164c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:22 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da61759-7d34-4c27-af5b-0c85e3ad164c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:22 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:23 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da61759-7d34-4c27-af5b-0c85e3ad164c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.404s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:23 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 is being set with open permissions: ugo+rw Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:23 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:23 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "cinder-d229d66d-4eb0-4125-8bbb-125b8508b3e0-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:23 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-d229d66d-4eb0-4125-8bbb-125b8508b3e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "cinder-quobyte-d229d66d-4eb0-4125-8bbb-125b8508b3e0" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-d229d66d-4eb0-4125-8bbb-125b8508b3e0" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Deleting offline snapshot d229d66d-4eb0-4125-8bbb-125b8508b3e0 of volume 2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] snapshot_file for this snap is: volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:31:23 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info Nov 05 08:31:23 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc7270-bcee-4151-9f18-d77f2333e42f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:23 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 Nov 05 08:31:23 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info is being set with open permissions: ugo+rw Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:24 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info Nov 05 08:31:24 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0" returned: 0 in 0.503s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e7af8-4e8d-4a90-8de7-e6f573f272e0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:24 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.info" returned: 0 in 0.343s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-77ccdf06-4f90-4fc5-b566-984cb020399b tempest-VolumesSnapshotTestJSON-471597244 None] Create snapshot completed successfully Nov 05 08:31:24 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 Nov 05 08:31:24 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-27439a44-04df-4e22-bb4d-9fa10cb7ec00 req-0debdab9-d42d-48aa-86eb-6e09fe5ff705 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-27439a44-04df-4e22-bb4d-9fa10cb7ec00 req-0debdab9-d42d-48aa-86eb-6e09fe5ff705 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-27439a44-04df-4e22-bb4d-9fa10cb7ec00 req-0debdab9-d42d-48aa-86eb-6e09fe5ff705 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-27439a44-04df-4e22-bb4d-9fa10cb7ec00 req-0debdab9-d42d-48aa-86eb-6e09fe5ff705 tempest-TestServerVolumeAttachmentScenario-51650833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-028f3a4e-e841-4043-8a75-7a248675d39f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9126277f-3de8-4c4d-99e5-8d0752a91590', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:31:24 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956" returned: 0 in 0.532s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:24 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 Nov 05 08:31:24 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-27439a44-04df-4e22-bb4d-9fa10cb7ec00 req-0debdab9-d42d-48aa-86eb-6e09fe5ff705 tempest-TestServerVolumeAttachmentScenario-51650833 None] attachment_update completed successfully. Nov 05 08:31:25 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0" returned: 0 in 0.541s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:25 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0 Nov 05 08:31:25 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (181841b9-0a5a-4753-8a72-4e8c6bc47a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f002dc1c-b085-4899-a075-78f032043d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f002dc1c-b085-4899-a075-78f032043d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-116406313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db030a60-a71f-4eff-bbe6-18d2835dc534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9186f5f3-55a2-47d1-829b-cb3c711bc2c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:25Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6142ef6-c432-40e3-bb06-b88dbaabce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6142ef6-c432-40e3-bb06-b88dbaabce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef46606b-3d16-4e15-a0c8-b6ba71f8deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef46606b-3d16-4e15-a0c8-b6ba71f8deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db030a60-a71f-4eff-bbe6-18d2835dc534', 'volume_name': 'volume-db030a60-a71f-4eff-bbe6-18d2835dc534', 'volume_size': 2, 'snapshot_id': '9186f5f3-55a2-47d1-829b-cb3c711bc2c8'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94392e16-464b-4c54-adff-b6129720e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94392e16-464b-4c54-adff-b6129720e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b1a2a5-4583-416f-9ded-dee7393c26bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Volume db030a60-a71f-4eff-bbe6-18d2835dc534: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db030a60-a71f-4eff-bbe6-18d2835dc534', 'volume_size': 2, 'snapshot_id': '9186f5f3-55a2-47d1-829b-cb3c711bc2c8'} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-db030a60-a71f-4eff-bbe6-18d2835dc534" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-db030a60-a71f-4eff-bbe6-18d2835dc534" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Creating volume db030a60-a71f-4eff-bbe6-18d2835dc534 from snapshot 9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:25 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] snapshot: 9186f5f3-55a2-47d1-829b-cb3c711bc2c8, volume: db030a60-a71f-4eff-bbe6-18d2835dc534, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956.d229d66d-4eb0-4125-8bbb-125b8508b3e0" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-d229d66d-4eb0-4125-8bbb-125b8508b3e0" released by "_delete_snapshot" :: held 2.159s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" released by "delete_snapshot" :: held 2.200s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de6810d-d521-49e9-81ed-32141ba4e7f5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Created reservations ['674e4646-8624-4239-b20b-e4ece0b54def', '41da4f26-e5f2-4a8c-abb9-317250b42da8', '5096ebb1-8da3-4f3a-ba33-c4b778f7bdb2', '2c457b28-da43-4778-b08f-03d1907586bb'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:26 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:26 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Delete snapshot completed successfully. Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-08f53970-3d4f-4404-acb6-c2786423ea0b tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-d229d66d-4eb0-4125-8bbb-125b8508b3e0-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:26 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.406s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da61759-7d34-4c27-af5b-0c85e3ad164c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db1db59-1a59-46d1-9e20-19e9280d9a62]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:26 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:31:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 Nov 05 08:31:26 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "cinder-2c3dfa2b-422f-4be8-b634-1ffba7e65956-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Flow 'volume_create_manager' (4c365186-7a8b-465a-8683-99c486ac5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d2811-5ea9-4fba-83f5-f2a98660761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-2c3dfa2b-422f-4be8-b634-1ffba7e65956-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d2811-5ea9-4fba-83f5-f2a98660761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415487383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3f277a-8015-46f1-9b80-d7e74ac167bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2d4759d5a6435fb65ea51fdc6f3e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:27Z,use_quota=True,user_id='478b1e7d573043769bbe641e5fd6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b5edb6-99dd-4e0e-8cda-c0af459942b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b5edb6-99dd-4e0e-8cda-c0af459942b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8d6d29-129c-4f8c-ad28-380e97b16d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[183708ed-0ca2-442d-8df2-420b87c4a9d4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:28 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 Nov 05 08:31:28 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8d6d29-129c-4f8c-ad28-380e97b16d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f3f277a-8015-46f1-9b80-d7e74ac167bd', 'volume_name': 'volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0447e2a-6bd3-45ba-a364-1f37440ea170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0447e2a-6bd3-45ba-a364-1f37440ea170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56f8190-07a4-4b3b-a6ae-613a89b6f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Trying to clone 7f3f277a-8015-46f1-9b80-d7e74ac167bd from image 0f972b89-5809-49af-bb61-4f969e240750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:31:28 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956" returned: 0 in 1.062s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:29 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956 Nov 05 08:31:29 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:31:29 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b3b8e-d011-4f70-9b51-e9d870dbb026]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:29 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD Nov 05 08:31:29 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:29 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2c3dfa2b-422f-4be8-b634-1ffba7e65956" returned: 0 in 0.788s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:29 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD" returned: 0 in 0.582s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 is fetched for user 478b1e7d573043769bbe641e5fd6fe7e. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-quobyte-2c3dfa2b-422f-4be8-b634-1ffba7e65956" released by "delete_volume" :: held 2.050s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:29 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Created reservations ['7e52a97e-3b5a-4772-8fee-97783db4b9ef', '05ef680d-6149-4181-95c3-198a26abf21c', 'e587eb4f-9d78-44bb-9f27-84a68cd70245', '859a86da-7e57-488d-983b-b187d38f3423'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacff8f-1e93-4872-86c3-b7cef8ef1b2b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:30 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:30 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:30 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD Nov 05 08:31:30 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:30 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:30 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD" returned: 0 in 0.565s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:30 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Deleted volume successfully. Nov 05 08:31:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-55baa416-5b39-451a-a0da-c44db2794839 tempest-VolumeSnapshotQuotasNegativeTestJSON-556799235 None] Lock "cinder-2c3dfa2b-422f-4be8-b634-1ffba7e65956-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-96cce1f3-e4ec-4bac-a220-1ab98055d90d req-688226cc-d716-4a06-bc45-01b5ea27179b tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:35 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534" returned: 0 in 8.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:31:35 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Converted 1024.00 MB image at 121.93 MB/s Nov 05 08:31:35 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 is being set with open permissions: ugo+rw Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:35 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 Nov 05 08:31:35 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:35 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534" returned: 0 in 0.273s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" released by "_copy_volume_from_snapshot" :: held 9.621s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-db030a60-a71f-4eff-bbe6-18d2835dc534" released by "_create_volume_from_snapshot" :: held 9.712s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.733s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.873s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415487383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3f277a-8015-46f1-9b80-d7e74ac167bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2d4759d5a6435fb65ea51fdc6f3e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:27Z,use_quota=True,user_id='478b1e7d573043769bbe641e5fd6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Creating volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:35 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:35 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1073741824 Nov 05 08:31:35 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b1a2a5-4583-416f-9ded-dee7393c26bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db030a60-a71f-4eff-bbe6-18d2835dc534', 'volume_size': 2, 'snapshot_id': '9186f5f3-55a2-47d1-829b-cb3c711bc2c8'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa67f19e-b366-412a-bb4a-8927bca86285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Volume volume-db030a60-a71f-4eff-bbe6-18d2835dc534 (db030a60-a71f-4eff-bbe6-18d2835dc534): created successfully Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa67f19e-b366-412a-bb4a-8927bca86285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (181841b9-0a5a-4753-8a72-4e8c6bc47a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-44ff4da1-4120-42e2-83f5-f055a5774fcf tempest-VolumesSnapshotTestJSON-471597244 None] Created volume successfully. Nov 05 08:31:35 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1073741824" returned: 0 in 0.480s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:36 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd Nov 05 08:31:36 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:36 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-96cce1f3-e4ec-4bac-a220-1ab98055d90d req-688226cc-d716-4a06-bc45-01b5ea27179b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.314s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-96cce1f3-e4ec-4bac-a220-1ab98055d90d req-688226cc-d716-4a06-bc45-01b5ea27179b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Attempting download of 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-96cce1f3-e4ec-4bac-a220-1ab98055d90d req-688226cc-d716-4a06-bc45-01b5ea27179b tempest-TestServerVolumeAttachmentScenario-51650833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '163c49e6-d8d1-4fe1-9f6b-428b89c73493', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca040445-bc8e-4be9-a421-b12a0b9f23da]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-96cce1f3-e4ec-4bac-a220-1ab98055d90d req-688226cc-d716-4a06-bc45-01b5ea27179b tempest-TestServerVolumeAttachmentScenario-51650833 None] attachment_update completed successfully. Nov 05 08:31:36 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w Nov 05 08:31:36 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-db030a60-a71f-4eff-bbe6-18d2835dc534-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-db030a60-a71f-4eff-bbe6-18d2835dc534-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:36 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w" returned: 0 in 0.483s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:36 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w Nov 05 08:31:37 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480de38-12bf-425c-adfd-b422e7629e1b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:37 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 Nov 05 08:31:37 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:37 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w" returned: 1 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_vxyv8f9w' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a314f6-7a02-4728-90dd-60f664fdbd21]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:37 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD Nov 05 08:31:37 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:37 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534" returned: 0 in 0.428s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:37 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534 Nov 05 08:31:37 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:37 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] 0f972b89-5809-49af-bb61-4f969e240750 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:37 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd Nov 05 08:31:37 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:37 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-db030a60-a71f-4eff-bbe6-18d2835dc534" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-db030a60-a71f-4eff-bbe6-18d2835dc534" released by "delete_volume" :: held 0.825s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['65cca74c-428b-4cc2-b307-2d943248ed29', '06919d51-aac7-4ff2-9961-a4f744494683', '545707dc-bfa2-4f33-8714-38d35618d4d6', '36305404-8715-449f-ba9a-c0de918cef1e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:38 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:38 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:38 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:38 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Deleted volume successfully. Nov 05 08:31:38 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-449ac411-6cda-4fda-b307-625ea8e12f3d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-db030a60-a71f-4eff-bbe6-18d2835dc534-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-1cece100-bd3c-4ce0-aa4f-46bb49b91887 req-75458c7b-8894-4865-af78-9e3c6f385753 tempest-TestServerVolumeAttachmentScenario-51650833 None] Terminate volume connection completed successfully. Nov 05 08:31:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-1cece100-bd3c-4ce0-aa4f-46bb49b91887 req-75458c7b-8894-4865-af78-9e3c6f385753 tempest-TestServerVolumeAttachmentScenario-51650833 None] Deleting attachment 163c49e6-d8d1-4fe1-9f6b-428b89c73493. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Deleting offline snapshot 9186f5f3-55a2-47d1-829b-cb3c711bc2c8 of volume 3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] snapshot_file for this snap is: volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a6b099-1479-4860-b1a8-95869c7ca927]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:39 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:39 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:39 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.481s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da61759-7d34-4c27-af5b-0c85e3ad164c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797fdcb-60d7-40b7-8e54-474780c3ec8e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:39 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:39 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=104,cinder:UPDATE=91,cinder:INSERT=22,cinder:DELETE=11 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:31:40 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=103,cinder:SELECT=86,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd" returned: 0 in 2.507s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_cq5m_cd8devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Converted 112.00 MB image at 44.66 MB/s Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:40 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1G Nov 05 08:31:40 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Flow 'volume_create_manager' (98255f4c-e682-46a7-9e4c-de3f38b354f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5e5118-f0b5-4f09-bcd6-9a810a626904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5e5118-f0b5-4f09-bcd6-9a810a626904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-990245172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46628383-bc75-454a-aea3-8d3ffc61536a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d80f2c149d148939612077408c1e5a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:40Z,use_quota=True,user_id='5ac23c90deba4ec5b88f9bb47009671e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97ca76d-3921-434a-9a0f-c871488df257),volume_type_id=c97ca76d-3921-434a-9a0f-c871488df257)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1101517-3cee-471a-ae65-9b690c9f0f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1101517-3cee-471a-ae65-9b690c9f0f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9643ee10-cc67-4248-ba36-ea1453421bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9643ee10-cc67-4248-ba36-ea1453421bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46628383-bc75-454a-aea3-8d3ffc61536a', 'volume_name': 'volume-46628383-bc75-454a-aea3-8d3ffc61536a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900c192c-e511-470d-8ee7-35303a80abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900c192c-e511-470d-8ee7-35303a80abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90a9c9e-bdc5-400b-91d9-9316f259b896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Volume 46628383-bc75-454a-aea3-8d3ffc61536a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46628383-bc75-454a-aea3-8d3ffc61536a', 'volume_size': 1} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-990245172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46628383-bc75-454a-aea3-8d3ffc61536a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d80f2c149d148939612077408c1e5a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:40Z,use_quota=True,user_id='5ac23c90deba4ec5b88f9bb47009671e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97ca76d-3921-434a-9a0f-c871488df257),volume_type_id=c97ca76d-3921-434a-9a0f-c871488df257)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Creating volume 46628383-bc75-454a-aea3-8d3ffc61536a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a 1073741824 Nov 05 08:31:40 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-2cc7093b-365e-4b09-9f40-3767dd13b3f5 req-4a21c963-00f1-4ba8-9d16-9afcf13c07ae tempest-TestServerVolumeAttachmentScenario-51650833 None] Terminate volume connection completed successfully. Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-2cc7093b-365e-4b09-9f40-3767dd13b3f5 req-4a21c963-00f1-4ba8-9d16-9afcf13c07ae tempest-TestServerVolumeAttachmentScenario-51650833 None] Deleting attachment 9126277f-3de8-4c4d-99e5-8d0752a91590. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:31:40 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.714s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:40 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd 1G" returned: 0 in 0.445s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Downloaded image 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 for user 478b1e7d573043769bbe641e5fd6fe7e is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Marking volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Copying metadata from image 0f972b89-5809-49af-bb61-4f969e240750 to 7f3f277a-8015-46f1-9b80-d7e74ac167bd. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Creating volume glance metadata for volume 7f3f277a-8015-46f1-9b80-d7e74ac167bd backed by image 0f972b89-5809-49af-bb61-4f969e240750 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56f8190-07a4-4b3b-a6ae-613a89b6f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bae49d4-5ff7-48e4-aa4b-a0980d6d74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Volume volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd (7f3f277a-8015-46f1-9b80-d7e74ac167bd): created successfully Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bae49d4-5ff7-48e4-aa4b-a0980d6d74c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Flow 'volume_create_manager' (4c365186-7a8b-465a-8683-99c486ac5f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:40 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3594712f-a545-4008-ba03-d1a3d32b2cf3 tempest-VolumesImageMetadata-100798789 None] Created volume successfully. Nov 05 08:31:40 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a 1073741824" returned: 0 in 0.580s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.428s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8 Nov 05 08:31:40 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a Nov 05 08:31:40 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:41 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:41 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c.9186f5f3-55a2-47d1-829b-cb3c711bc2c8" returned: 0 in 0.302s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90a9c9e-bdc5-400b-91d9-9316f259b896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46628383-bc75-454a-aea3-8d3ffc61536a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea0e36f-db88-4455-8e0f-fc12dba74149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Volume volume-46628383-bc75-454a-aea3-8d3ffc61536a (46628383-bc75-454a-aea3-8d3ffc61536a): created successfully Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea0e36f-db88-4455-8e0f-fc12dba74149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Flow 'volume_create_manager' (98255f4c-e682-46a7-9e4c-de3f38b354f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-9186f5f3-55a2-47d1-829b-cb3c711bc2c8" released by "_delete_snapshot" :: held 2.119s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" released by "delete_snapshot" :: held 2.148s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dc716d9d-096c-48af-a86d-4c891cf8ae5b tempest-VolumeTypesAccessTest-163887511 None] Created volume successfully. Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['c6c974ad-5579-40f1-8581-05bd7b8ff120', '181745a8-f579-447e-abaa-c07afb07c709', 'cef07775-0dde-48dd-ad95-456965d5f695', '21a95aca-0f77-48fa-946a-8c31455dedd2'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Delete snapshot completed successfully. Nov 05 08:31:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8f5f1b6e-d44e-490c-8793-968436959202 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-9186f5f3-55a2-47d1-829b-cb3c711bc2c8-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Acquiring lock "cinder-46628383-bc75-454a-aea3-8d3ffc61536a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "cinder-46628383-bc75-454a-aea3-8d3ffc61536a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Acquiring lock "cinder-quobyte-46628383-bc75-454a-aea3-8d3ffc61536a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "cinder-quobyte-46628383-bc75-454a-aea3-8d3ffc61536a" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e56ac3-356a-41f4-91b0-d0e74cbb4af3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-3da61759-7d34-4c27-af5b-0c85e3ad164c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a Nov 05 08:31:42 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-3da61759-7d34-4c27-af5b-0c85e3ad164c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Acquiring lock "cinder-7f3f277a-8015-46f1-9b80-d7e74ac167bd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "cinder-7f3f277a-8015-46f1-9b80-d7e74ac167bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Acquiring lock "cinder-quobyte-7f3f277a-8015-46f1-9b80-d7e74ac167bd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "cinder-quobyte-7f3f277a-8015-46f1-9b80-d7e74ac167bd" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e6a673-0955-4c69-b0a8-627408de4f2c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feaf3ba-2f66-4677-81e5-c617d02579e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:42 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd Nov 05 08:31:43 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a" returned: 0 in 0.685s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a Nov 05 08:31:43 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.549s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c Nov 05 08:31:43 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd" returned: 0 in 0.578s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd Nov 05 08:31:43 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46628383-bc75-454a-aea3-8d3ffc61536a" returned: 0 in 0.370s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "cinder-quobyte-46628383-bc75-454a-aea3-8d3ffc61536a" released by "delete_volume" :: held 1.147s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack cinder-volume[87101]: WARNING cinder.quota [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-978776438 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-978776438, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:31:43 devstack cinder-volume[87101]: WARNING cinder.quota [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-978776438 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-978776438, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Created reservations ['39d17798-5256-4b6e-b55a-3ca1a742e47e', '54d19b05-f7e2-47fc-a943-9d91f20d9a7c', '7e4f802e-4d03-404b-863d-d00f0a26a3b7', '67cce2b7-51e3-4004-a5b1-b42f71c52e4c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:43 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3da61759-7d34-4c27-af5b-0c85e3ad164c" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-3da61759-7d34-4c27-af5b-0c85e3ad164c" released by "delete_volume" :: held 1.026s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7f3f277a-8015-46f1-9b80-d7e74ac167bd" returned: 0 in 0.359s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "cinder-quobyte-7f3f277a-8015-46f1-9b80-d7e74ac167bd" released by "delete_volume" :: held 1.023s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['fc57bcd1-6bc7-48fd-a2d3-b418147b7595', 'fceba1b4-385b-45ad-bec1-e14673c0b69a', '74050dde-c8bb-4772-8a73-083393bdbba4', '2d7ab3b5-7921-4eba-97f6-76c2ef4fd31b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Created reservations ['c9611119-e9bb-490e-bdf1-fe62c1b9e8da', '1e9b1973-28fd-4ac4-ab1d-10e3818d7171', 'e43fe2d9-b763-40c5-b326-c71eb6d60abb', '392d9e71-f357-4c57-aa56-15b1b269b895'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:44 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:44 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:44 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Deleted volume successfully. Nov 05 08:31:44 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:44 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b2c3bd9-6a11-4735-b31e-3978d4f971e1 tempest-VolumeTypesAccessTest-163887511 None] Lock "cinder-46628383-bc75-454a-aea3-8d3ffc61536a-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:44 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Deleted volume successfully. Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e1dfbf87-1961-4590-a376-571931706670 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-3da61759-7d34-4c27-af5b-0c85e3ad164c-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:44 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.273s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Deleted volume successfully. Nov 05 08:31:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b59cf526-a965-462e-85bd-c9dc93daade9 tempest-VolumesImageMetadata-100798789 None] Lock "cinder-7f3f277a-8015-46f1-9b80-d7e74ac167bd-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "cinder-2545abff-e3f2-4b70-8ace-4d2b8a1915b0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-2545abff-e3f2-4b70-8ace-4d2b8a1915b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "cinder-quobyte-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-quobyte-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[16335333-d910-4e19-ab3d-1ac688de6728]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 Nov 05 08:31:45 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (5cb9e667-9606-4250-b9d5-d581b4536363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b3b999-15f3-432c-b8b9-345b62c6b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b3b999-15f3-432c-b8b9-345b62c6b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135115116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7ae643-9d15-4777-a1e6-e1b97a95c5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:46Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad5da77-753e-4d7a-b860-4753fad3a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad5da77-753e-4d7a-b860-4753fad3a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa72c03f-d655-499d-b4c3-bc81b1402b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa72c03f-d655-499d-b4c3-bc81b1402b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7ae643-9d15-4777-a1e6-e1b97a95c5f1', 'volume_name': 'volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7a0ff-ee58-44aa-be95-66a66bc3bc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7a0ff-ee58-44aa-be95-66a66bc3bc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0966f9-09a4-4463-a1b9-7bebb1c03001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Volume cb7ae643-9d15-4777-a1e6-e1b97a95c5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1', 'volume_size': 1} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135115116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7ae643-9d15-4777-a1e6-e1b97a95c5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:46Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Creating volume cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:45 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:45 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" returned: 0 in 0.541s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 1073741824 Nov 05 08:31:45 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0 Nov 05 08:31:45 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-quobyte-2545abff-e3f2-4b70-8ace-4d2b8a1915b0" released by "delete_volume" :: held 0.892s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Created reservations ['ba6ef474-0915-42b9-8098-dda9f75fbe11', 'c49a4c8d-b752-4334-8fe3-4f33c387e485', '8dad06b3-6f44-464d-b08d-28d7c026492a', '81cc4d3e-898f-4129-b05e-e73616099d6f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:46 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:46 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 1073741824" returned: 0 in 0.608s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "cinder-028f3a4e-e841-4043-8a75-7a248675d39f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-028f3a4e-e841-4043-8a75-7a248675d39f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:46 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:31:46 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "cinder-quobyte-028f3a4e-e841-4043-8a75-7a248675d39f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-quobyte-028f3a4e-e841-4043-8a75-7a248675d39f" acquired by "delete_volume" :: waited 0.048s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a8d51-c806-4450-8479-e46ccf6be8b0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:46 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.454s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Deleted volume successfully. Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-18e25740-2180-4462-a576-f1ce95dbf50b tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-2545abff-e3f2-4b70-8ace-4d2b8a1915b0-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:46 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f Nov 05 08:31:46 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.429s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0966f9-09a4-4463-a1b9-7bebb1c03001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc96183-852c-4010-b58a-4ff974b76326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Volume volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 (cb7ae643-9d15-4777-a1e6-e1b97a95c5f1): created successfully Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc96183-852c-4010-b58a-4ff974b76326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (5cb9e667-9606-4250-b9d5-d581b4536363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5f232ad5-bebd-4349-9cd2-b58a111120be tempest-VolumesSnapshotTestJSON-471597244 None] Created volume successfully. Nov 05 08:31:47 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f" returned: 0 in 0.526s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f Nov 05 08:31:47 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-028f3a4e-e841-4043-8a75-7a248675d39f" returned: 0 in 0.290s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-quobyte-028f3a4e-e841-4043-8a75-7a248675d39f" released by "delete_volume" :: held 0.901s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Created reservations ['1a0fdaf5-3cb5-40fe-bf6d-f8883477898e', 'cf8c9c56-2cbf-4aec-80ad-257674bfb877', '9cd7f1b4-39fc-462f-b084-f39d43f459a9', '5e5854f6-7a98-4969-87c2-09eb5a5179a4'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:47 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Deleted volume successfully. Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c1d9c3a7-5125-49d0-9af6-073c035c9fb5 tempest-TestServerVolumeAttachmentScenario-51650833 None] Lock "cinder-028f3a4e-e841-4043-8a75-7a248675d39f-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Creating offline snapshot b795fc3a-2eda-454b-a8ed-515ef573107e of volume cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32041c1-d889-41dd-9a82-b9d333b490d8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:48 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:31:48 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:48 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:31:48 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.473s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:48 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e 1G Nov 05 08:31:48 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:31:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:31:49 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e 1G" returned: 0 in 0.590s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:49 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:31:49 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:49 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.436s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:49 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e is being set with open permissions: ugo+rw Nov 05 08:31:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:49 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:31:49 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:50 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info Nov 05 08:31:50 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Flow 'volume_create_manager' (b8b4e83f-2389-4c84-9a64-32b6e8b8313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41853b2d-98a9-4ed0-b000-013202ce35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41853b2d-98a9-4ed0-b000-013202ce35ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1732899473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d16eef9-27a4-4d8c-b438-23c140164413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3139f3c59f5648fab12b6704cc08518d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:50Z,use_quota=True,user_id='825e8c22011e4000a119b6be7810890e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db6107a-a02f-4ce8-8869-55049e1a7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db6107a-a02f-4ce8-8869-55049e1a7498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b2db8-0500-4075-b8a0-bd4b777a068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b2db8-0500-4075-b8a0-bd4b777a068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d16eef9-27a4-4d8c-b438-23c140164413', 'volume_name': 'volume-3d16eef9-27a4-4d8c-b438-23c140164413', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a5453-7c70-430f-b122-4eaf4f18afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a5453-7c70-430f-b122-4eaf4f18afad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d534bf4-9f70-4dc3-85a0-40236b05af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Volume 3d16eef9-27a4-4d8c-b438-23c140164413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d16eef9-27a4-4d8c-b438-23c140164413', 'volume_size': 1} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:50 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info" returned: 0 in 0.316s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:50 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info is being set with open permissions: ugo+rw Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:50 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info Nov 05 08:31:50 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.info" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1732899473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d16eef9-27a4-4d8c-b438-23c140164413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3139f3c59f5648fab12b6704cc08518d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:50Z,use_quota=True,user_id='825e8c22011e4000a119b6be7810890e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Creating volume 3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:50 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:31:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:50 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 1073741824 Nov 05 08:31:50 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-83c77cbe-4f35-4a24-b67b-cff74684222e tempest-VolumesSnapshotTestJSON-471597244 None] Create snapshot completed successfully Nov 05 08:31:51 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 1073741824" returned: 0 in 0.544s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:51 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 Nov 05 08:31:51 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:51 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413" returned: 0 in 0.312s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d534bf4-9f70-4dc3-85a0-40236b05af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d16eef9-27a4-4d8c-b438-23c140164413', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5318d-47fd-4f72-9c8b-1db9a6a1556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:51 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Volume volume-3d16eef9-27a4-4d8c-b438-23c140164413 (3d16eef9-27a4-4d8c-b438-23c140164413): created successfully Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5318d-47fd-4f72-9c8b-1db9a6a1556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Flow 'volume_create_manager' (b8b4e83f-2389-4c84-9a64-32b6e8b8313d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-41a21b52-8527-4a96-844c-00442ee1d2eb tempest-SnapshotMetadataTestJSON-1736017660 None] Created volume successfully. Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (ab3d09fc-8d0f-44ea-9077-b9f7768f97f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59797b29-dce2-482c-93ce-abe7d3213d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59797b29-dce2-482c-93ce-abe7d3213d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-770619221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a83317-7d24-4e33-80a3-db4cb3e66892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc534445ca2e40e5b84ef9ccd1901ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b795fc3a-2eda-454b-a8ed-515ef573107e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:52Z,use_quota=True,user_id='fcce2c36d79741aeabfca37458d97de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8827834d-0e1a-4b60-bb80-44f65169c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8827834d-0e1a-4b60-bb80-44f65169c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04bafc0-2a9e-4656-be53-c4f77d36b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04bafc0-2a9e-4656-be53-c4f77d36b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09a83317-7d24-4e33-80a3-db4cb3e66892', 'volume_name': 'volume-09a83317-7d24-4e33-80a3-db4cb3e66892', 'volume_size': 1, 'snapshot_id': 'b795fc3a-2eda-454b-a8ed-515ef573107e'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f828e63-9cd5-419b-afa5-8292820aaeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f828e63-9cd5-419b-afa5-8292820aaeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec9999f-8aa1-4bb2-bd3f-f8da64fa141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Volume 09a83317-7d24-4e33-80a3-db4cb3e66892: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09a83317-7d24-4e33-80a3-db4cb3e66892', 'volume_size': 1, 'snapshot_id': 'b795fc3a-2eda-454b-a8ed-515ef573107e'} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e-09a83317-7d24-4e33-80a3-db4cb3e66892" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e-09a83317-7d24-4e33-80a3-db4cb3e66892" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Creating volume 09a83317-7d24-4e33-80a3-db4cb3e66892 from snapshot b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] snapshot: b795fc3a-2eda-454b-a8ed-515ef573107e, volume: 09a83317-7d24-4e33-80a3-db4cb3e66892, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae616cf-c5eb-4305-b94d-1fe3137d664a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:52 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:31:52 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:52 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.445s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae2b3e5-2a64-4a03-9c96-947b4519f354]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:52 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:31:52 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:53 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.517s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:53 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 Nov 05 08:31:53 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Flow 'volume_create_manager' (da5298cb-514d-4c27-b83c-ee4c9cdf901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ff2309-e7f2-4088-851b-d7de3da6e73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ff2309-e7f2-4088-851b-d7de3da6e73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1434697839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8660a277-b56d-411c-bf19-2c9a119df2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea2c33183b644d38a8d7fe7fabf7874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:54Z,use_quota=True,user_id='bdade06325cf48ccbef4c8995fd55755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f64b504-8c59-4796-9e4d-70d5e81f3e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f64b504-8c59-4796-9e4d-70d5e81f3e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aa988a-faee-4bd2-ad3f-ead11fb82659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aa988a-faee-4bd2-ad3f-ead11fb82659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8660a277-b56d-411c-bf19-2c9a119df2e8', 'volume_name': 'volume-8660a277-b56d-411c-bf19-2c9a119df2e8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65390c8-5828-4f8e-92b9-f4c20750514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65390c8-5828-4f8e-92b9-f4c20750514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08790d6c-b49d-4d0f-b97a-47cfd5c59d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Volume 8660a277-b56d-411c-bf19-2c9a119df2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8660a277-b56d-411c-bf19-2c9a119df2e8', 'volume_size': 1} Nov 05 08:31:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:59 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892" returned: 0 in 6.616s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:59 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:31:59 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Converted 1024.00 MB image at 154.72 MB/s Nov 05 08:31:59 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 is being set with open permissions: ugo+rw Nov 05 08:31:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:59 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 Nov 05 08:31:59 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:00 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892" returned: 0 in 0.324s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" released by "_copy_volume_from_snapshot" :: held 8.019s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e-09a83317-7d24-4e33-80a3-db4cb3e66892" released by "_create_volume_from_snapshot" :: held 8.099s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.126s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.700s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Creating offline snapshot e9554d85-6b8f-442e-9832-b18c6810c039 of volume 3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec9999f-8aa1-4bb2-bd3f-f8da64fa141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a83317-7d24-4e33-80a3-db4cb3e66892', 'volume_size': 1, 'snapshot_id': 'b795fc3a-2eda-454b-a8ed-515ef573107e'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758aa99e-a86a-4e82-b0f6-2d75d53d811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7650ebac-8120-40e6-8421-d8abdb6a5f03]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Volume volume-09a83317-7d24-4e33-80a3-db4cb3e66892 (09a83317-7d24-4e33-80a3-db4cb3e66892): created successfully Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758aa99e-a86a-4e82-b0f6-2d75d53d811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Flow 'volume_create_manager' (ab3d09fc-8d0f-44ea-9077-b9f7768f97f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-415b1278-27d9-443a-a8ba-c6ef10b0ff47 tempest-VolumesSnapshotTestJSON-471597244 None] Created volume successfully. Nov 05 08:32:00 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 Nov 05 08:32:00 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:00 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:00 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 1G Nov 05 08:32:00 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-09a83317-7d24-4e33-80a3-db4cb3e66892-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-09a83317-7d24-4e33-80a3-db4cb3e66892-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bad8c8-faaf-43b6-a05c-348bca0f985f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:01 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 Nov 05 08:32:01 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:01 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 1G" returned: 0 in 0.560s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d16eef9-27a4-4d8c-b438-23c140164413 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:01 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d16eef9-27a4-4d8c-b438-23c140164413 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 Nov 05 08:32:01 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:01 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892" returned: 0 in 0.460s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:01 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892 Nov 05 08:32:01 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:01 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d16eef9-27a4-4d8c-b438-23c140164413 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039" returned: 0 in 0.325s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:01 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 is being set with open permissions: ugo+rw Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:01 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 Nov 05 08:32:01 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:01 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-09a83317-7d24-4e33-80a3-db4cb3e66892" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-09a83317-7d24-4e33-80a3-db4cb3e66892" released by "delete_volume" :: held 0.784s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['7559635d-046e-4ae6-86fa-3ae4c637316c', '5bc06676-e646-4075-bf63-a643e6de4a7b', 'e88aeb68-86da-4924-9699-20c6c5ab9166', 'ec72ce80-1058-4e2f-b983-e6a5b26c08ff'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:01 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:01 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:01 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:02 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info Nov 05 08:32:02 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-b795fc3a-2eda-454b-a8ed-515ef573107e-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-b795fc3a-2eda-454b-a8ed-515ef573107e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Deleting offline snapshot b795fc3a-2eda-454b-a8ed-515ef573107e of volume cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:02 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] snapshot_file for this snap is: volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2dab8d-c8c7-4de7-80f0-c2df407b69c7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:02 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Deleted volume successfully. Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf3dcea0-3d8b-462e-a8e7-631f167eedc8 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-09a83317-7d24-4e33-80a3-db4cb3e66892-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:02 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info is being set with open permissions: ugo+rw Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:02 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info Nov 05 08:32:02 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:02 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:32:02 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:02 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.info" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.947s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1434697839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8660a277-b56d-411c-bf19-2c9a119df2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea2c33183b644d38a8d7fe7fabf7874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:54Z,use_quota=True,user_id='bdade06325cf48ccbef4c8995fd55755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Creating volume 8660a277-b56d-411c-bf19-2c9a119df2e8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:02 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:02 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.431s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:02 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 1073741824 Nov 05 08:32:02 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f8f95-2411-42df-8659-b007c33a0762]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:02 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-37804e17-3c5a-4fb3-96c6-4d53f7c98ea3 tempest-SnapshotMetadataTestJSON-1736017660 None] Create snapshot completed successfully Nov 05 08:32:02 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:32:02 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:03 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 1073741824" returned: 0 in 0.566s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:03 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 Nov 05 08:32:03 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:03 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.670s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:03 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:32:03 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:03 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8" returned: 0 in 0.340s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08790d6c-b49d-4d0f-b97a-47cfd5c59d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8660a277-b56d-411c-bf19-2c9a119df2e8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e73e83-a5a9-483d-8d52-e799a44b6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:03 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Volume volume-8660a277-b56d-411c-bf19-2c9a119df2e8 (8660a277-b56d-411c-bf19-2c9a119df2e8): created successfully Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e73e83-a5a9-483d-8d52-e799a44b6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Flow 'volume_create_manager' (da5298cb-514d-4c27-b83c-ee4c9cdf901a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2fb5e910-c0be-4ce0-b24b-e6c3e6dd73fa tempest-AbsoluteLimitsTests-1184713219 None] Created volume successfully. Nov 05 08:32:03 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.427s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:03 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e Nov 05 08:32:03 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1.b795fc3a-2eda-454b-a8ed-515ef573107e" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "cinder-e9554d85-6b8f-442e-9832-b18c6810c039-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-b795fc3a-2eda-454b-a8ed-515ef573107e" released by "_delete_snapshot" :: held 1.973s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-e9554d85-6b8f-442e-9832-b18c6810c039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" released by "delete_snapshot" :: held 2.013s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "cinder-quobyte-e9554d85-6b8f-442e-9832-b18c6810c039" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-e9554d85-6b8f-442e-9832-b18c6810c039" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Deleting offline snapshot e9554d85-6b8f-442e-9832-b18c6810c039 of volume 3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] snapshot_file for this snap is: volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa003ca5-56e1-4fd3-9c29-87957573c304]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['96a92f8d-7a76-485f-b527-254f05cfa0bc', '42733db5-937f-4751-9557-cb0cd89efb9d', '2c8af0eb-9fd2-4bfd-b2f0-37309c9c42bd', '1d5f9ca7-5ec7-47e1-95fb-16751281f174'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Delete snapshot completed successfully. Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2219dc4-1a5f-490f-82df-491d88ddea1b tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-b795fc3a-2eda-454b-a8ed-515ef573107e-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:04 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 Nov 05 08:32:04 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d16eef9-27a4-4d8c-b438-23c140164413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6c66f-614c-47fc-8d80-125118ee88ac]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Acquiring lock "cinder-8660a277-b56d-411c-bf19-2c9a119df2e8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:04 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 Nov 05 08:32:04 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "cinder-8660a277-b56d-411c-bf19-2c9a119df2e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Acquiring lock "cinder-quobyte-8660a277-b56d-411c-bf19-2c9a119df2e8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "cinder-quobyte-8660a277-b56d-411c-bf19-2c9a119df2e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1bc99-db59-4d78-b0a7-b3b5e13c7c35]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 Nov 05 08:32:05 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 Nov 05 08:32:05 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (46ff123d-1b1f-4320-8886-110eb5870260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99adedc-c2b8-435b-891d-92ea39edb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99adedc-c2b8-435b-891d-92ea39edb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962612760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5792c27-c7f4-42e1-81cc-95ce6e2dfd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:05Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5512894-bab9-45d9-80d5-f612b0bc959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5512894-bab9-45d9-80d5-f612b0bc959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d5ce71-8f79-4cc2-b832-85f30b6e95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d5ce71-8f79-4cc2-b832-85f30b6e95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5792c27-c7f4-42e1-81cc-95ce6e2dfd67', 'volume_name': 'volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d77e4e-4f5d-4d83-b9ba-b9c13e9f4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d77e4e-4f5d-4d83-b9ba-b9c13e9f4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897be987-e51a-422f-8b29-586705e05d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume f5792c27-c7f4-42e1-81cc-95ce6e2dfd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67', 'volume_size': 1} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962612760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5792c27-c7f4-42e1-81cc-95ce6e2dfd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:05Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:05 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 1073741824 Nov 05 08:32:05 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8" returned: 0 in 0.451s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:05 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8 Nov 05 08:32:05 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:05 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:05 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039 Nov 05 08:32:05 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efd2a5-cff7-488d-9bd0-0ba589f25b48]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8660a277-b56d-411c-bf19-2c9a119df2e8" returned: 0 in 0.331s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:32:05 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "cinder-quobyte-8660a277-b56d-411c-bf19-2c9a119df2e8" released by "delete_volume" :: held 0.848s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Created reservations ['1deb6e76-2ca0-49db-9937-ddce812b29a3', 'd010f8ff-ab0e-46ee-86c0-5fdcb15a5b9e', 'c9fe54c9-fb52-4075-a59f-e27afffd34a4', 'd8aae35d-1054-42bf-be9a-e6b068b7ee0e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:05 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 1073741824" returned: 0 in 0.599s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413.e9554d85-6b8f-442e-9832-b18c6810c039" returned: 0 in 0.356s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 Nov 05 08:32:06 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:06 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:06 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-e9554d85-6b8f-442e-9832-b18c6810c039" released by "_delete_snapshot" :: held 1.868s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" released by "delete_snapshot" :: held 1.908s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.475s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1 Nov 05 08:32:06 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Created reservations ['93400589-539b-4e5b-890e-aef8730996fa', '69396d11-cad0-46a5-9681-fb2514e9d35f', '74bf8d11-f307-4ca8-8823-dbdd4e77bdd5', 'bcee0e5e-3d87-4a93-a201-9f07935f8ea8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:06 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Deleted volume successfully. Nov 05 08:32:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Delete snapshot completed successfully. Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7130a305-4e46-4f39-b796-029e0dc506db tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-e9554d85-6b8f-442e-9832-b18c6810c039-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1965ed70-ad8c-416d-be1d-c8d89f1e0c6d tempest-AbsoluteLimitsTests-1184713219 None] Lock "cinder-8660a277-b56d-411c-bf19-2c9a119df2e8-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" returned: 0 in 0.436s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897be987-e51a-422f-8b29-586705e05d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d46719-bc20-4b65-87bc-f38f7fb75716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 (f5792c27-c7f4-42e1-81cc-95ce6e2dfd67): created successfully Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d46719-bc20-4b65-87bc-f38f7fb75716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (46ff123d-1b1f-4320-8886-110eb5870260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7597753c-dd15-4f7b-9a2f-4e53d3602a8c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:06 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" returned: 0 in 0.396s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1" released by "delete_volume" :: held 0.958s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['f62d4418-04fd-4396-b198-4f41d47e406f', 'd9f68ceb-d27c-4ff5-aade-180e4e8ee96d', '3649fbb6-de2d-41ef-aaae-60e1874b383f', '6085dd07-736d-4a67-856e-7820d59f117d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:06 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:06 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Deleted volume successfully. Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ae28cb6b-9c02-4dc4-ac0b-a3cc6ce6fbb1 tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-cb7ae643-9d15-4777-a1e6-e1b97a95c5f1-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating offline snapshot 410aa9dd-68f6-47d9-a8bc-b9984e0ef966 of volume f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad92a5-1bb1-4f98-8230-d1e7f18429d5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "cinder-3d16eef9-27a4-4d8c-b438-23c140164413-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-3d16eef9-27a4-4d8c-b438-23c140164413-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:07 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 Nov 05 08:32:07 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcfbd8c-5d7d-4df5-9d82-b04831e5e9a8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-abd2349c-9526-4154-8586-b8595017da5d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-abd2349c-9526-4154-8586-b8595017da5d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:07 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 Nov 05 08:32:07 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:08 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" returned: 0 in 0.494s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e5cc3-fabc-445a-b8cd-b9c8dc9aeb49]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 1G Nov 05 08:32:08 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d Nov 05 08:32:08 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413" returned: 0 in 0.496s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413 Nov 05 08:32:08 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d" returned: 0 in 0.468s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d Nov 05 08:32:08 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3d16eef9-27a4-4d8c-b438-23c140164413" returned: 0 in 0.396s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 1G" returned: 0 in 0.640s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-quobyte-3d16eef9-27a4-4d8c-b438-23c140164413" released by "delete_volume" :: held 1.024s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:08 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 Nov 05 08:32:08 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Created reservations ['963cc900-bf7a-4968-be1b-ae2ec23145b9', 'abfd5fb3-a571-4e73-822b-b477acb88a05', '9cd1bfd0-405d-4b94-b19f-aafe1faab6b9', '6c937a5d-0208-4370-802b-149c7f2c6cf5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:08 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-abd2349c-9526-4154-8586-b8595017da5d" returned: 0 in 0.298s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-quobyte-abd2349c-9526-4154-8586-b8595017da5d" released by "delete_volume" :: held 0.861s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:08 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Created reservations ['b7a5d24e-0063-4566-97e7-eb644e22a3a3', '81c269db-6984-4731-bcb8-9e1d088e9b6e', 'cc808774-b1ad-4a11-9055-d2140e7925a7', 'a36278dd-ec2a-4a53-a0c5-f920e43cad5c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:09 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 is being set with open permissions: ugo+rw Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 Nov 05 08:32:09 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Deleted volume successfully. Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-77dd69aa-7b37-4dbf-8570-481bbbbed556 tempest-SnapshotMetadataTestJSON-1736017660 None] Lock "cinder-3d16eef9-27a4-4d8c-b438-23c140164413-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:09 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.325s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Deleted volume successfully. Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c2a2d1c4-ce81-4808-bae0-71c876ea825d tempest-VolumesSnapshotTestJSON-471597244 None] Lock "cinder-abd2349c-9526-4154-8586-b8595017da5d-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:09 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info Nov 05 08:32:09 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info" returned: 0 in 0.347s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info is being set with open permissions: ugo+rw Nov 05 08:32:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info Nov 05 08:32:09 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:10 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.info" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.800s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6ebe3aec-cedf-43f1-b5fa-1c0dd9ff518a tempest-CreateVolumesFromSnapshotTest-1060411933 None] Create snapshot completed successfully Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (05b9521c-57b3-495c-80c1-416a60efda78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daff8cd-042b-4ddf-865c-7a824e4c8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daff8cd-042b-4ddf-865c-7a824e4c8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094559150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309d978b-714c-4d40-9afc-6bd9bec0a1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:11Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9023fdf7-b595-418b-a6b5-f3d32931d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9023fdf7-b595-418b-a6b5-f3d32931d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8663eba7-9d09-46c1-875b-7922bb9fdcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8663eba7-9d09-46c1-875b-7922bb9fdcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309d978b-714c-4d40-9afc-6bd9bec0a1cc', 'volume_name': 'volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43a5dab-2158-4135-950b-ec729a979fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43a5dab-2158-4135-950b-ec729a979fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e75220-946e-4c52-94f0-08216305bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume 309d978b-714c-4d40-9afc-6bd9bec0a1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc', 'volume_size': 1} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094559150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309d978b-714c-4d40-9afc-6bd9bec0a1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:11Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume 309d978b-714c-4d40-9afc-6bd9bec0a1cc {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:11 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:11 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc 1073741824 Nov 05 08:32:11 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (9b78a3de-3e5d-4924-a0f4-53e8c0ec5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538d26e2-81ae-47d7-a8cf-74c88f2a95ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538d26e2-81ae-47d7-a8cf-74c88f2a95ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078711994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8c08ac-af89-4b79-ac43-09f51bfc2b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:12Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041af9ad-26c9-40bb-9818-739a7b7cb935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041af9ad-26c9-40bb-9818-739a7b7cb935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eab187-6910-49bc-9260-9eb3ed45f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eab187-6910-49bc-9260-9eb3ed45f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8c08ac-af89-4b79-ac43-09f51bfc2b67', 'volume_name': 'volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556c7786-d30f-49af-a2cc-6d282da6793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556c7786-d30f-49af-a2cc-6d282da6793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacbd28-167d-4c34-81ab-6d2d8c2ca2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume 6b8c08ac-af89-4b79-ac43-09f51bfc2b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67', 'volume_size': 1} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:12 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc 1073741824" returned: 0 in 0.674s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:12 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc Nov 05 08:32:12 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (31affe64-0446-4c61-a965-521308aa3968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f80ba4-4795-46ac-af7a-4718133a9bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f80ba4-4795-46ac-af7a-4718133a9bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639368237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41469766-fdf2-4b45-b449-d659132892ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750b7a31-9bc5-4b58-864d-6485521696eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750b7a31-9bc5-4b58-864d-6485521696eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392bc39f-f647-4238-aa46-0bba53ea65ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392bc39f-f647-4238-aa46-0bba53ea65ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41469766-fdf2-4b45-b449-d659132892ba', 'volume_name': 'volume-41469766-fdf2-4b45-b449-d659132892ba', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad0c4c2-85e1-43bb-9f3e-4e3815ff0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad0c4c2-85e1-43bb-9f3e-4e3815ff0c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fbd684-8149-4a2e-af76-7c3953b6f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:12 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume 41469766-fdf2-4b45-b449-d659132892ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41469766-fdf2-4b45-b449-d659132892ba', 'volume_size': 1} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:12 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc" returned: 0 in 0.504s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078711994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8c08ac-af89-4b79-ac43-09f51bfc2b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:12Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume 6b8c08ac-af89-4b79-ac43-09f51bfc2b67 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:12 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e75220-946e-4c52-94f0-08216305bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e8f5b2-c761-4997-a9c8-b4e322f2f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 1073741824 Nov 05 08:32:13 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc (309d978b-714c-4d40-9afc-6bd9bec0a1cc): created successfully Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e8f5b2-c761-4997-a9c8-b4e322f2f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (05b9521c-57b3-495c-80c1-416a60efda78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6a981f38-47e4-4d1b-84c8-9ee58ef34438 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (c0855b6a-bc5e-4a25-b49c-e5f820f0aa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f341d7b1-29b9-4071-8a68-0e2f79f7c5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f341d7b1-29b9-4071-8a68-0e2f79f7c5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-43686167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46711e96-fe18-4aeb-a174-3895cc718450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4facab0602b4810b940ab6be90ba894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='fed23ce951bd4f84b5d7b674e240ebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e14115-efa7-44e9-957e-7754916f4f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e14115-efa7-44e9-957e-7754916f4f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9555af-53c1-4327-8ef3-6f1b639fa68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9555af-53c1-4327-8ef3-6f1b639fa68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46711e96-fe18-4aeb-a174-3895cc718450', 'volume_name': 'volume-46711e96-fe18-4aeb-a174-3895cc718450', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c1aea4-8251-4ea6-8503-c7d24acc6851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c1aea4-8251-4ea6-8503-c7d24acc6851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28197ad0-98e6-4f80-a333-3c5b298c2589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Volume 46711e96-fe18-4aeb-a174-3895cc718450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46711e96-fe18-4aeb-a174-3895cc718450', 'volume_size': 1} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (b04b6391-232c-4f5a-8f02-4d962f61a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19da3865-0a0b-4020-8210-ca174769fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19da3865-0a0b-4020-8210-ca174769fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-422909738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9418d06c-f4fd-4270-bad0-13c098d7e4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c492f2ef-9196-4566-9d9a-4e8c575ed5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c492f2ef-9196-4566-9d9a-4e8c575ed5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba1d2bb-9f34-4c13-8cd8-be2569be41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba1d2bb-9f34-4c13-8cd8-be2569be41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9418d06c-f4fd-4270-bad0-13c098d7e4fc', 'volume_name': 'volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42850e16-dcd8-425b-9c1c-0f66d63bed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42850e16-dcd8-425b-9c1c-0f66d63bed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41721407-625a-4d1d-afd0-6e24cd9a1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume 9418d06c-f4fd-4270-bad0-13c098d7e4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc', 'volume_size': 1} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (46e7c739-b662-41c4-bce3-ab2c288f25d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e72398-0106-42bf-aef6-708381c80246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 1073741824" returned: 0 in 0.861s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e72398-0106-42bf-aef6-708381c80246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910685494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4c3980-0cff-44c1-a86e-be3288460ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:14Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46c8623-9f91-4525-b0ae-29700680c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46c8623-9f91-4525-b0ae-29700680c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980619ac-3ee3-47c8-923e-3d9fc26a1c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980619ac-3ee3-47c8-923e-3d9fc26a1c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4c3980-0cff-44c1-a86e-be3288460ac1', 'volume_name': 'volume-ee4c3980-0cff-44c1-a86e-be3288460ac1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444f9a5c-fe4d-4279-b793-75906374d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444f9a5c-fe4d-4279-b793-75906374d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3561c2-9db9-41f9-90d5-c2fe6bc2ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume ee4c3980-0cff-44c1-a86e-be3288460ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4c3980-0cff-44c1-a86e-be3288460ac1', 'volume_size': 1} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:13 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 Nov 05 08:32:13 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:14 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639368237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41469766-fdf2-4b45-b449-d659132892ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume 41469766-fdf2-4b45-b449-d659132892ba {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:14 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacbd28-167d-4c34-81ab-6d2d8c2ca2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:14 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba 1073741824 Nov 05 08:32:14 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ab0a6c-0e20-45e5-b426-55b41e95ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:14 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 (6b8c08ac-af89-4b79-ac43-09f51bfc2b67): created successfully Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ab0a6c-0e20-45e5-b426-55b41e95ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (9b78a3de-3e5d-4924-a0f4-53e8c0ec5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-000bd33d-61ec-4854-b256-c97217db2fdd tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:14 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba 1073741824" returned: 0 in 0.666s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:14 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba Nov 05 08:32:14 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:15 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-43686167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46711e96-fe18-4aeb-a174-3895cc718450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4facab0602b4810b940ab6be90ba894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='fed23ce951bd4f84b5d7b674e240ebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Creating volume 46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:15 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fbd684-8149-4a2e-af76-7c3953b6f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41469766-fdf2-4b45-b449-d659132892ba', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4542098b-388e-45e8-8f01-6e1f1cdca2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:15 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 1073741824 Nov 05 08:32:15 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-41469766-fdf2-4b45-b449-d659132892ba (41469766-fdf2-4b45-b449-d659132892ba): created successfully Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4542098b-388e-45e8-8f01-6e1f1cdca2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (31affe64-0446-4c61-a965-521308aa3968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3ade7add-f0ea-422c-a022-adff642693ab tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:15 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 1073741824" returned: 0 in 0.597s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:15 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 Nov 05 08:32:15 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:16 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-422909738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9418d06c-f4fd-4270-bad0-13c098d7e4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:13Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume 9418d06c-f4fd-4270-bad0-13c098d7e4fc {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:16 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28197ad0-98e6-4f80-a333-3c5b298c2589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46711e96-fe18-4aeb-a174-3895cc718450', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ea0a5-cfb0-4f35-9993-0af0d00cfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:16 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc 1073741824 Nov 05 08:32:16 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Volume volume-46711e96-fe18-4aeb-a174-3895cc718450 (46711e96-fe18-4aeb-a174-3895cc718450): created successfully Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ea0a5-cfb0-4f35-9993-0af0d00cfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (c0855b6a-bc5e-4a25-b49c-e5f820f0aa18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d2d4769e-9cca-4526-977f-707d507dc0f7 tempest-VolumesDeleteCascade-1700107760 None] Created volume successfully. Nov 05 08:32:16 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc 1073741824" returned: 0 in 0.562s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:16 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc Nov 05 08:32:16 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:17 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.310s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910685494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4c3980-0cff-44c1-a86e-be3288460ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3900b02495a84eb2807b1055cb684dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:14Z,use_quota=True,user_id='4e638e4794924e8eba2770fea152e2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Creating volume ee4c3980-0cff-44c1-a86e-be3288460ac1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:17 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41721407-625a-4d1d-afd0-6e24cd9a1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:17 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 1073741824 Nov 05 08:32:17 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3981d8c8-7771-4fb2-8454-a880002ff058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc (9418d06c-f4fd-4270-bad0-13c098d7e4fc): created successfully Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3981d8c8-7771-4fb2-8454-a880002ff058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (b04b6391-232c-4f5a-8f02-4d962f61a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4a7135ff-f01c-49d3-8476-c0abd0986ad0 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:17 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 1073741824" returned: 0 in 0.636s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:17 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 Nov 05 08:32:17 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:18 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1" returned: 0 in 0.269s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.792s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Creating offline snapshot a1126cd6-7156-4128-a297-b0ebfec1c089 of volume 46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3561c2-9db9-41f9-90d5-c2fe6bc2ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4c3980-0cff-44c1-a86e-be3288460ac1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1360e5-77f3-4b49-acfa-7a6c300376f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcbc8e0-397e-4578-b514-bacff6c448e7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Volume volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 (ee4c3980-0cff-44c1-a86e-be3288460ac1): created successfully Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1360e5-77f3-4b49-acfa-7a6c300376f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Flow 'volume_create_manager' (46e7c739-b662-41c4-bce3-ab2c288f25d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-72397a37-0633-4fae-b159-ecc03e1ce83d tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created volume successfully. Nov 05 08:32:18 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 Nov 05 08:32:18 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:18 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450" returned: 0 in 0.429s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:18 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 1G Nov 05 08:32:18 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:19 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 1G" returned: 0 in 0.512s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:19 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:19 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-ee4c3980-0cff-44c1-a86e-be3288460ac1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-ee4c3980-0cff-44c1-a86e-be3288460ac1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-ee4c3980-0cff-44c1-a86e-be3288460ac1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-ee4c3980-0cff-44c1-a86e-be3288460ac1" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[452e1d7e-3cbb-4369-ba43-c3f36a82cb3e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:19 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.516s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:19 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 is being set with open permissions: ugo+rw Nov 05 08:32:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:19 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:19 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:19 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 Nov 05 08:32:19 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.298s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1" returned: 0 in 0.444s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info Nov 05 08:32:20 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1 Nov 05 08:32:20 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ee4c3980-0cff-44c1-a86e-be3288460ac1" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-ee4c3980-0cff-44c1-a86e-be3288460ac1" released by "delete_volume" :: held 0.792s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info" returned: 0 in 0.321s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info is being set with open permissions: ugo+rw Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info Nov 05 08:32:20 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['ff0ff98e-48fb-420f-a9a2-4984b84abebd', '65248caf-2701-4bac-9e1d-7019aa3e7e83', 'f790176e-6553-490d-be44-8cf8f48091bd', 'd3d35e8c-8b42-48f9-b433-e8f515e15b00'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:20 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.info" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-9418d06c-f4fd-4270-bad0-13c098d7e4fc-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-9418d06c-f4fd-4270-bad0-13c098d7e4fc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6fe35078-992e-4375-905d-294cb2c23828 tempest-VolumesDeleteCascade-1700107760 None] Create snapshot completed successfully Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-9418d06c-f4fd-4270-bad0-13c098d7e4fc" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-9418d06c-f4fd-4270-bad0-13c098d7e4fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc053b92-1681-491e-87d7-693dc758db3c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:21 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.475s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0f1f6877-e822-4026-80a3-e410f2ef1e94 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-ee4c3980-0cff-44c1-a86e-be3288460ac1-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:21 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc Nov 05 08:32:21 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:21 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc" returned: 0 in 0.440s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:21 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc Nov 05 08:32:21 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9418d06c-f4fd-4270-bad0-13c098d7e4fc" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:21 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-9418d06c-f4fd-4270-bad0-13c098d7e4fc" released by "delete_volume" :: held 0.943s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Creating offline snapshot 238eb936-3a2e-4a47-9905-941cbcc2407d of volume 46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['6f4f44e0-9f45-4024-b29a-ed237ab03ef0', '87fa4789-4e8e-4452-ad9d-a88520993d35', 'bc14d40e-9a54-41b0-abf1-d07a93f18375', '18bb8b3d-89b8-4e6a-9d03-1e0dd659afe5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[239fbef5-ea3f-4cdc-9ccf-5b499fe11070]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:22 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:22 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:22 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:22 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:22 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.339s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a6fc4c68-e089-4be5-8d5c-715389b37957 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-9418d06c-f4fd-4270-bad0-13c098d7e4fc-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:22 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.572s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46711e96-fe18-4aeb-a174-3895cc718450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:22 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d 1G Nov 05 08:32:22 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-41469766-fdf2-4b45-b449-d659132892ba-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-41469766-fdf2-4b45-b449-d659132892ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-41469766-fdf2-4b45-b449-d659132892ba" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-41469766-fdf2-4b45-b449-d659132892ba" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd39edd-c757-4917-80d9-5df9d4a2dd61]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:23 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d 1G" returned: 0 in 0.627s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:23 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d Nov 05 08:32:23 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba Nov 05 08:32:23 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d" returned: 0 in 0.354s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:23 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d is being set with open permissions: ugo+rw Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:23 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d Nov 05 08:32:23 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba" returned: 0 in 0.440s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:23 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba Nov 05 08:32:23 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:24 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41469766-fdf2-4b45-b449-d659132892ba" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e869707a-1268-4a06-bedf-c56815bec47e tempest-VolumesDeleteCascade-1700107760 None] Create snapshot completed successfully Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-41469766-fdf2-4b45-b449-d659132892ba" released by "delete_volume" :: held 0.934s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['d3420053-e20c-4d70-bd62-fa73b339818c', '25a48969-bca9-4148-ae62-8525bc77cbcd', 'b48d8388-bcb9-4f2a-85f9-81e42e4804f6', '91b89376-2ea7-43d0-b529-930fca44798b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:24 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:24 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:24 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-85313afc-1045-48fc-a9ae-073b5e6aeb42 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-41469766-fdf2-4b45-b449-d659132892ba-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-46711e96-fe18-4aeb-a174-3895cc718450-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-46711e96-fe18-4aeb-a174-3895cc718450-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Performing cascade delete. {{(pid=87101) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-238eb936-3a2e-4a47-9905-941cbcc2407d-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-238eb936-3a2e-4a47-9905-941cbcc2407d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-238eb936-3a2e-4a47-9905-941cbcc2407d" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-238eb936-3a2e-4a47-9905-941cbcc2407d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Deleting offline snapshot 238eb936-3a2e-4a47-9905-941cbcc2407d of volume 46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] snapshot_file for this snap is: volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-6b8c08ac-af89-4b79-ac43-09f51bfc2b67-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd44e202-8c24-4b65-9428-e3eadf4047f7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-6b8c08ac-af89-4b79-ac43-09f51bfc2b67-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe54b47-8f9e-4417-bc35-ebe5b8b42919]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:25 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d Nov 05 08:32:25 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:25 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 Nov 05 08:32:25 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d" returned: 0 in 0.571s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46711e96-fe18-4aeb-a174-3895cc718450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:26 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" returned: 0 in 0.471s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[57901341-408a-41eb-9f34-85fa9431cadb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67 Nov 05 08:32:26 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:26 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-6b8c08ac-af89-4b79-ac43-09f51bfc2b67" released by "delete_volume" :: held 0.922s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['fbeaf599-5996-4ed7-b7ee-512530687ce7', '817e2369-aa2b-4355-b983-1a06e8059a37', 'f588dadc-6fe6-4a8d-ae15-2c8b3be368f6', '6006bd5b-76bc-4ac1-b431-ec1841fdae47'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-309d978b-714c-4d40-9afc-6bd9bec0a1cc-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:26 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.657s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46711e96-fe18-4aeb-a174-3895cc718450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-309d978b-714c-4d40-9afc-6bd9bec0a1cc-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:26 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:26 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d Nov 05 08:32:26 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-309d978b-714c-4d40-9afc-6bd9bec0a1cc" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-309d978b-714c-4d40-9afc-6bd9bec0a1cc" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc36c6-589f-499a-9bbf-882f069a741e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:27 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc Nov 05 08:32:27 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:27 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.449s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c631e91-6cdf-4edc-8266-5a638ac40f1c tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-6b8c08ac-af89-4b79-ac43-09f51bfc2b67-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:27 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d" returned: 0 in 0.584s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:27 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d Nov 05 08:32:27 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:27 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:27 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc Nov 05 08:32:27 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:27 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.238eb936-3a2e-4a47-9905-941cbcc2407d" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-238eb936-3a2e-4a47-9905-941cbcc2407d" released by "_delete_snapshot" :: held 2.333s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:27 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" released by "delete_snapshot" :: held 2.370s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-309d978b-714c-4d40-9afc-6bd9bec0a1cc" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-309d978b-714c-4d40-9afc-6bd9bec0a1cc" released by "delete_volume" :: held 0.915s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['4ebc2bbd-04bb-4d40-bc51-ea37049b1cf5', '40faea1c-82c1-4ede-a3a5-f8e09fd0368e', '9c82a630-bf1e-40ee-bea2-5a69d7b843eb', '9e0cf68f-185b-4f43-a96c-c0b3afa3924a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:27 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['ed46d73b-a906-4edb-b9b6-531ba5401401', 'dbd7d418-4e9d-49f9-ad2b-a56efac782b1', '1c97702b-1cc8-44c0-bd96-64388e5fe71c', '1d31aec7-9c87-4c7b-be83-14ae8379642d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:28 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Delete snapshot completed successfully. Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-238eb936-3a2e-4a47-9905-941cbcc2407d-delete_snapshot" released by "delete_snapshot" :: held 2.695s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-a1126cd6-7156-4128-a297-b0ebfec1c089-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-a1126cd6-7156-4128-a297-b0ebfec1c089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-a1126cd6-7156-4128-a297-b0ebfec1c089" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-a1126cd6-7156-4128-a297-b0ebfec1c089" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Deleting offline snapshot a1126cd6-7156-4128-a297-b0ebfec1c089 of volume 46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:28 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:28 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] snapshot_file for this snap is: volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355c1ec-d53b-4a38-a1d4-71b4b6a3a6ef]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:28 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:28 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:28 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:28 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8bd7cdfe-5e03-4b22-b11d-2dcd8427dc55 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-309d978b-714c-4d40-9afc-6bd9bec0a1cc-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:28 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46711e96-fe18-4aeb-a174-3895cc718450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c2c59c-52e7-4067-81a0-d9a1ad71070b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:28 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 Nov 05 08:32:28 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-410aa9dd-68f6-47d9-a8bc-b9984e0ef966-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-410aa9dd-68f6-47d9-a8bc-b9984e0ef966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-410aa9dd-68f6-47d9-a8bc-b9984e0ef966" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-410aa9dd-68f6-47d9-a8bc-b9984e0ef966" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleting offline snapshot 410aa9dd-68f6-47d9-a8bc-b9984e0ef966 of volume f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] snapshot_file for this snap is: volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:29 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450" returned: 0 in 0.454s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01bf60-c7e9-4bea-9b28-216eb21846a8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:29 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:29 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:29 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 Nov 05 08:32:29 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:29 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:29 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089 Nov 05 08:32:29 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:29 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966" returned: 0 in 0.512s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddbd1c-4574-465d-a7e3-0cb1ab69bb6e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:29 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 Nov 05 08:32:29 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450.a1126cd6-7156-4128-a297-b0ebfec1c089" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-a1126cd6-7156-4128-a297-b0ebfec1c089" released by "_delete_snapshot" :: held 1.924s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" released by "delete_snapshot" :: held 1.964s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Flow 'volume_create_manager' (453fb20c-bc51-4dc3-b3d5-947c7abb006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f03ea9-527c-4565-8bd5-66d0268ed4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f03ea9-527c-4565-8bd5-66d0268ed4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208668224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5185429b-cb68-4369-97f3-66a2a7fd7d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0217439d62a4657a53b79c5b294c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:30Z,use_quota=True,user_id='de4136ce229742a9aa7d919d97228147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f31d0f9-4d8b-42a0-bc94-e53be3fef03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f31d0f9-4d8b-42a0-bc94-e53be3fef03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7bb2ee-4063-4426-be25-df0291eb78ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7bb2ee-4063-4426-be25-df0291eb78ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5185429b-cb68-4369-97f3-66a2a7fd7d38', 'volume_name': 'volume-5185429b-cb68-4369-97f3-66a2a7fd7d38', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3778b-f86d-4768-bde6-d0322e7e7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3778b-f86d-4768-bde6-d0322e7e7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c25069-5647-4cc1-abe8-442f122468d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:30 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Volume 5185429b-cb68-4369-97f3-66a2a7fd7d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5185429b-cb68-4369-97f3-66a2a7fd7d38', 'volume_size': 1} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208668224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5185429b-cb68-4369-97f3-66a2a7fd7d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0217439d62a4657a53b79c5b294c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:30Z,use_quota=True,user_id='de4136ce229742a9aa7d919d97228147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Creating volume 5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:30 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 1073741824 Nov 05 08:32:30 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" returned: 0 in 0.473s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['22ddae6a-ab0e-4a2e-b680-3b1a42807c6f', '746e2543-b2c8-4a94-91e1-bd2fa2178865', '1148ef84-0219-48ac-9ff4-7b45e59926e5', '80cfa3d2-18f3-4892-a82f-80e4b52498ae'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:30 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 Nov 05 08:32:30 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Delete snapshot completed successfully. Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-a1126cd6-7156-4128-a297-b0ebfec1c089-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Snapshots deleted, issuing volume delete {{(pid=87101) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" acquired by "delete_volume" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ea640-4846-4f43-bfc7-8011f7407de3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 Nov 05 08:32:30 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966 Nov 05 08:32:30 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 1073741824" returned: 0 in 0.625s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:32:30 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450" returned: 0 in 0.475s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:31 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450 Nov 05 08:32:31 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:31 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67.410aa9dd-68f6-47d9-a8bc-b9984e0ef966" returned: 0 in 0.340s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-410aa9dd-68f6-47d9-a8bc-b9984e0ef966" released by "_delete_snapshot" :: held 2.033s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" released by "delete_snapshot" :: held 2.065s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['da4aa557-f8a3-4a74-a250-25ce99f48b14', '28351611-6869-4f3d-82a6-5748e938a2a2', 'eb8a5ae0-57f3-4167-b5cd-45f2d244552d', 'e82b6d61-07fa-4f55-873e-540836907414'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:31 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Delete snapshot completed successfully. Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c25069-5647-4cc1-abe8-442f122468d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5185429b-cb68-4369-97f3-66a2a7fd7d38', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697c2982-9090-4c7c-86f3-1df2d42578e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-add18253-7eaa-4a49-a959-6535420bf30f tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-410aa9dd-68f6-47d9-a8bc-b9984e0ef966-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Volume volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 (5185429b-cb68-4369-97f3-66a2a7fd7d38): created successfully Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697c2982-9090-4c7c-86f3-1df2d42578e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Flow 'volume_create_manager' (453fb20c-bc51-4dc3-b3d5-947c7abb006d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:31 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-46711e96-fe18-4aeb-a174-3895cc718450" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-46711e96-fe18-4aeb-a174-3895cc718450" released by "delete_volume" :: held 0.887s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f0e58595-dd48-427c-84e2-9d0ebaf4be8e tempest-VolumesActionsTest-1320477972 None] Created volume successfully. Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['c42f39e3-bc1e-485f-a9d9-b5a87b58657a', '0d012458-23f0-4086-9575-65d877fa4607', 'fd37cfda-7b84-4dd5-b2a0-6f1565811d3d', 'a6f9a7e6-6306-4e98-946e-8e519bd395aa'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:31 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:31 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:31 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Deleted volume successfully. Nov 05 08:32:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-99916e02-02c9-49ea-b55b-4588477c9066 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-46711e96-fe18-4aeb-a174-3895cc718450-delete_volume" released by "delete_volume" :: held 6.502s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56cc466-e8df-4b6b-8690-781f4efe9c4a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:32 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 Nov 05 08:32:32 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (6bc9c5dd-1d01-4b23-ad79-1ac5e9abfaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617d350e-247e-4306-b92a-59a893ae9537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617d350e-247e-4306-b92a-59a893ae9537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-31823286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2a732-c238-44dd-bea6-84a25fc88c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4facab0602b4810b940ab6be90ba894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:33Z,use_quota=True,user_id='fed23ce951bd4f84b5d7b674e240ebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171c5801-4b37-4cc0-85f1-0a327f7fd299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171c5801-4b37-4cc0-85f1-0a327f7fd299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc98d16-46d2-4866-9406-f7b3fa4e9bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc98d16-46d2-4866-9406-f7b3fa4e9bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d2a732-c238-44dd-bea6-84a25fc88c62', 'volume_name': 'volume-80d2a732-c238-44dd-bea6-84a25fc88c62', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54b192d-d7f0-429e-b0bc-72acfa4998cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54b192d-d7f0-429e-b0bc-72acfa4998cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf87bd79-2edd-4b26-b97c-146143efce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Volume 80d2a732-c238-44dd-bea6-84a25fc88c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d2a732-c238-44dd-bea6-84a25fc88c62', 'volume_size': 1} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-31823286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2a732-c238-44dd-bea6-84a25fc88c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4facab0602b4810b940ab6be90ba894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:33Z,use_quota=True,user_id='fed23ce951bd4f84b5d7b674e240ebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Creating volume 80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:33 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" returned: 0 in 0.631s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:33 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 1073741824 Nov 05 08:32:33 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:33 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67 Nov 05 08:32:33 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:33 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" returned: 0 in 0.380s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-quobyte-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67" released by "delete_volume" :: held 1.128s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Created reservations ['1b0493bf-0c51-43ca-808a-3081527a4199', 'b8a3b222-c3b1-4958-b279-228e7edaadf3', '43263cb9-8f8a-44f8-abf4-f8162d86f1bf', '59d21bf4-e0e4-4724-a705-272f14de8a57'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:33 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:33 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:33 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 1073741824" returned: 0 in 0.700s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:33 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:33 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:34 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Deleted volume successfully. Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c7782934-2629-4dcb-8d5b-46c87da9a620 tempest-CreateVolumesFromSnapshotTest-1060411933 None] Lock "cinder-f5792c27-c7f4-42e1-81cc-95ce6e2dfd67-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:34 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.376s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf87bd79-2edd-4b26-b97c-146143efce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d2a732-c238-44dd-bea6-84a25fc88c62', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dec2eab-5a87-471c-905a-7ee5ab287e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Volume volume-80d2a732-c238-44dd-bea6-84a25fc88c62 (80d2a732-c238-44dd-bea6-84a25fc88c62): created successfully Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dec2eab-5a87-471c-905a-7ee5ab287e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (6bc9c5dd-1d01-4b23-ad79-1ac5e9abfaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ae90cc26-dd23-4213-a116-8fd1676618fd tempest-VolumesDeleteCascade-1700107760 None] Created volume successfully. Nov 05 08:32:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Creating offline snapshot 50e7c326-d35e-4ce5-b9d8-3061c5b4c21a of volume 80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b7d06a-d128-4539-a23e-9306aecee91a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:35 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:35 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:36 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.641s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:36 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a 1G Nov 05 08:32:36 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:36 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a 1G" returned: 0 in 0.569s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d2a732-c238-44dd-bea6-84a25fc88c62 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:36 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d2a732-c238-44dd-bea6-84a25fc88c62 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:36 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:37 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d2a732-c238-44dd-bea6-84a25fc88c62 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:37 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a is being set with open permissions: ugo+rw Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:37 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:37 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:37 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:37 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info Nov 05 08:32:37 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:37 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:37 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info is being set with open permissions: ugo+rw Nov 05 08:32:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:37 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info Nov 05 08:32:37 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:38 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.info" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:38 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-398bf008-3b2d-4f2e-ada9-9f4bf3907ae6 tempest-VolumesDeleteCascade-1700107760 None] Create snapshot completed successfully Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (e7ec889f-6b6a-4c3a-a0e4-b3e0d4486e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265987f2-bd43-4267-a9a4-8d4db1a79544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265987f2-bd43-4267-a9a4-8d4db1a79544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-791499391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531e1626-aab9-44b8-996f-fde08178a1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4facab0602b4810b940ab6be90ba894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50e7c326-d35e-4ce5-b9d8-3061c5b4c21a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:39Z,use_quota=True,user_id='fed23ce951bd4f84b5d7b674e240ebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e1e05f-5e56-49c1-b548-a63b4e49b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e1e05f-5e56-49c1-b548-a63b4e49b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c39ce1-d8a8-4cbb-bdc9-cbc9e4cdd566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c39ce1-d8a8-4cbb-bdc9-cbc9e4cdd566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '531e1626-aab9-44b8-996f-fde08178a1d4', 'volume_name': 'volume-531e1626-aab9-44b8-996f-fde08178a1d4', 'volume_size': 1, 'snapshot_id': '50e7c326-d35e-4ce5-b9d8-3061c5b4c21a'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140745ce-7289-4682-9d72-4b8b540339e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140745ce-7289-4682-9d72-4b8b540339e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cca209-d0c9-432f-84c0-2671658e0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Volume 531e1626-aab9-44b8-996f-fde08178a1d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-531e1626-aab9-44b8-996f-fde08178a1d4', 'volume_size': 1, 'snapshot_id': '50e7c326-d35e-4ce5-b9d8-3061c5b4c21a'} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-531e1626-aab9-44b8-996f-fde08178a1d4" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c0c48278-3c05-4d77-9027-f1662cb67c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590f4a5f-c2ca-4c98-bab1-a1593735f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-531e1626-aab9-44b8-996f-fde08178a1d4" acquired by "_create_volume_from_snapshot" :: waited 0.069s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Creating volume 531e1626-aab9-44b8-996f-fde08178a1d4 from snapshot 50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590f4a5f-c2ca-4c98-bab1-a1593735f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059651127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7aa2b8-c152-431d-a5bf-f7356bbd812a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:39Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e1dae-ae9c-41f4-8a6b-50c3aff45ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e1dae-ae9c-41f4-8a6b-50c3aff45ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cf2c45-4c72-44d3-8706-179fd5d1b29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cf2c45-4c72-44d3-8706-179fd5d1b29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7aa2b8-c152-431d-a5bf-f7356bbd812a', 'volume_name': 'volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126c814d-83c8-4ead-b38d-0e62dfc06d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126c814d-83c8-4ead-b38d-0e62dfc06d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64528374-b2ae-4a5d-8a37-04699f0be0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume df7aa2b8-c152-431d-a5bf-f7356bbd812a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a', 'volume_size': 1} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" acquired by "_copy_volume_from_snapshot" :: waited 0.109s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] snapshot: 50e7c326-d35e-4ce5-b9d8-3061c5b4c21a, volume: 531e1626-aab9-44b8-996f-fde08178a1d4, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f32f344-0186-4702-8d56-078df64dc13e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:40 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:40 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:40 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.716s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d2a732-c238-44dd-bea6-84a25fc88c62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a409600-5763-4b9c-9ffc-3aaa8803b6f2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:40 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:40 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:41 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.762s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:32:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:32:41 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:32:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:41 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 Nov 05 08:32:41 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38eeb432-443b-4622-bd62-d99ed664a23c tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" by "attach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38eeb432-443b-4622-bd62-d99ed664a23c tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" acquired by "attach_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:44 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=173,cinder:UPDATE=221,cinder:INSERT=68,cinder:DELETE=22 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:32:44 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=183,cinder:INSERT=56,cinder:UPDATE=224,cinder:DELETE=16 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:32:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38eeb432-443b-4622-bd62-d99ed664a23c tempest-VolumesActionsTest-1320477972 None] Attaching volume 5185429b-cb68-4369-97f3-66a2a7fd7d38 to instance b6d8903b-5850-4a74-972c-e9116fd7f30d at mountpoint /dev/vdb on host None. Nov 05 08:32:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38eeb432-443b-4622-bd62-d99ed664a23c tempest-VolumesActionsTest-1320477972 None] Attach volume completed successfully. Nov 05 08:32:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38eeb432-443b-4622-bd62-d99ed664a23c tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" released by "attach_volume" :: held 0.183s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2c2085b7-c5d2-47e4-8158-91ac216b7c31 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" by "detach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2c2085b7-c5d2-47e4-8158-91ac216b7c31 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2c2085b7-c5d2-47e4-8158-91ac216b7c31 tempest-VolumesActionsTest-1320477972 None] Detaching volume 5185429b-cb68-4369-97f3-66a2a7fd7d38 from instance b6d8903b-5850-4a74-972c-e9116fd7f30d. Nov 05 08:32:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2c2085b7-c5d2-47e4-8158-91ac216b7c31 tempest-VolumesActionsTest-1320477972 None] Detach volume completed successfully. Nov 05 08:32:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2c2085b7-c5d2-47e4-8158-91ac216b7c31 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" released by "detach_volume" :: held 0.197s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:48 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:48 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:49 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.666s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:32:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:32:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:32:51 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4" returned: 0 in 10.234s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:51 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:32:51 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Converted 1024.00 MB image at 100.05 MB/s Nov 05 08:32:51 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 is being set with open permissions: ugo+rw Nov 05 08:32:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:51 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 Nov 05 08:32:51 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:52 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4" returned: 0 in 0.341s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" released by "_copy_volume_from_snapshot" :: held 12.264s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-531e1626-aab9-44b8-996f-fde08178a1d4" released by "_create_volume_from_snapshot" :: held 12.461s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.532s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.344s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059651127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7aa2b8-c152-431d-a5bf-f7356bbd812a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:39Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume df7aa2b8-c152-431d-a5bf-f7356bbd812a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:52 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:52 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a 1073741824 Nov 05 08:32:52 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cca209-d0c9-432f-84c0-2671658e0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531e1626-aab9-44b8-996f-fde08178a1d4', 'volume_size': 1, 'snapshot_id': '50e7c326-d35e-4ce5-b9d8-3061c5b4c21a'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b2a40d-e401-4b66-b185-3da026f1e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Volume volume-531e1626-aab9-44b8-996f-fde08178a1d4 (531e1626-aab9-44b8-996f-fde08178a1d4): created successfully Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b2a40d-e401-4b66-b185-3da026f1e31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Flow 'volume_create_manager' (e7ec889f-6b6a-4c3a-a0e4-b3e0d4486e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-73133b5a-9d8f-4052-b6e6-1f3543ed19e3 tempest-VolumesDeleteCascade-1700107760 None] Created volume successfully. Nov 05 08:32:52 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a 1073741824" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:52 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a Nov 05 08:32:52 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:53 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a" returned: 0 in 0.308s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64528374-b2ae-4a5d-8a37-04699f0be0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c1833b-ecdc-48d9-bc2f-adb019588020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:53 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a (df7aa2b8-c152-431d-a5bf-f7356bbd812a): created successfully Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c1833b-ecdc-48d9-bc2f-adb019588020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c0c48278-3c05-4d77-9027-f1662cb67c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-80d2a732-c238-44dd-bea6-84a25fc88c62-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-093621e9-b781-4b72-aef9-3bbc35f27561 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-80d2a732-c238-44dd-bea6-84a25fc88c62-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Performing cascade delete. {{(pid=87101) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Deleting offline snapshot 50e7c326-d35e-4ce5-b9d8-3061c5b4c21a of volume 80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] snapshot_file for this snap is: volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb487e9-0001-4673-b588-30cf6bf6aadd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:53 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:53 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:54 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.627s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d2a732-c238-44dd-bea6-84a25fc88c62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f80a8-9cfa-4733-85e0-092646d0ea24]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:54 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:54 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c7658577-e4e1-4607-8f17-e64e0490a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1854447-7520-4fe1-a3f1-a1867d66a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.976s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1854447-7520-4fe1-a3f1-a1867d66a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248598275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86675419-8305-4cb1-b0a6-5570ebffe3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:55Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1b5f90-6334-4191-99ab-4a57fe9c4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:55 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1b5f90-6334-4191-99ab-4a57fe9c4252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f4cb7-54f3-4b07-ab54-86cc045cf333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f4cb7-54f3-4b07-ab54-86cc045cf333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86675419-8305-4cb1-b0a6-5570ebffe3fb', 'volume_name': 'volume-86675419-8305-4cb1-b0a6-5570ebffe3fb', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59437e3f-45cc-4b64-96fd-53ffb44c36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59437e3f-45cc-4b64-96fd-53ffb44c36aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9abe9-dd5c-43fe-9b32-099711410c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume 86675419-8305-4cb1-b0a6-5570ebffe3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86675419-8305-4cb1-b0a6-5570ebffe3fb', 'volume_size': 1} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248598275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86675419-8305-4cb1-b0a6-5570ebffe3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:55Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume 86675419-8305-4cb1-b0a6-5570ebffe3fb {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:55 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:55 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb 1073741824 Nov 05 08:32:55 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c335e3e7-0b0d-4aa6-8906-bf88757d7e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321f3bfa-3021-47c6-b142-e1c121e64994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321f3bfa-3021-47c6-b142-e1c121e64994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734796511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:56Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8605f186-8454-4b49-84fe-9bfdd222e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8605f186-8454-4b49-84fe-9bfdd222e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c31746d-b657-4928-b4b2-9808adc5f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c31746d-b657-4928-b4b2-9808adc5f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5', 'volume_name': 'volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2669eb6-208b-41c9-9b05-aa5f812bcab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2669eb6-208b-41c9-9b05-aa5f812bcab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07edabd-eb0c-4e3c-80ed-6f569a2a9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume 1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5', 'volume_size': 1} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:55 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb 1073741824" returned: 0 in 0.697s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.836s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:55 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a Nov 05 08:32:55 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:56 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb Nov 05 08:32:56 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:56 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62.50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" returned: 0 in 0.393s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a" released by "_delete_snapshot" :: held 3.030s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:56 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (8da6f8d5-eb07-478e-b904-9dd3d339b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75165ee-f9a5-4475-bd64-9ddbe7a4f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" released by "delete_snapshot" :: held 3.128s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb" returned: 0 in 0.518s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734796511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:56Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume 1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:56 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75165ee-f9a5-4475-bd64-9ddbe7a4f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676963523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c3e0b-22f7-46b7-af56-e7c530037eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:56Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 1073741824 Nov 05 08:32:56 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a6c146-9844-4c77-84f3-27656ef43232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a6c146-9844-4c77-84f3-27656ef43232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd2508-d78f-48a8-ac0c-34ee98612133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd2508-d78f-48a8-ac0c-34ee98612133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3c3e0b-22f7-46b7-af56-e7c530037eb1', 'volume_name': 'volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c9a25a-8ad7-42f6-a624-b53632e727c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c9a25a-8ad7-42f6-a624-b53632e727c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334a6bc7-b484-4867-b0f1-5cdb86f691e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume 1d3c3e0b-22f7-46b7-af56-e7c530037eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1', 'volume_size': 1} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9abe9-dd5c-43fe-9b32-099711410c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86675419-8305-4cb1-b0a6-5570ebffe3fb', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f6ea1-53c4-4a1e-9a54-b825aed41264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-86675419-8305-4cb1-b0a6-5570ebffe3fb (86675419-8305-4cb1-b0a6-5570ebffe3fb): created successfully Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f6ea1-53c4-4a1e-9a54-b825aed41264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c7658577-e4e1-4607-8f17-e64e0490a85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f0b78a9b-77af-4508-a8fa-0f0471bf335d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:32:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['e790cd8c-66d9-4790-a512-f0dfec4a8414', '2c06db9e-5da8-46ac-93d3-e5ac936ead84', 'ebded408-c700-49b0-890f-c3c7912455d2', 'e17a7677-fe0b-4acb-b85e-4d12bca15e1a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Delete snapshot completed successfully. Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (eae97736-03dd-45f0-ac0e-4578f4dfa9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ae52a4-e978-4326-a5a4-506427825b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-50e7c326-d35e-4ce5-b9d8-3061c5b4c21a-delete_snapshot" released by "delete_snapshot" :: held 3.762s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Snapshots deleted, issuing volume delete {{(pid=87101) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ae52a4-e978-4326-a5a4-506427825b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665108089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a727903-9d99-4a2a-83a1-3f373241d5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:57Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2e03a4-c761-4c14-8fdd-e1e87f5bbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2e03a4-c761-4c14-8fdd-e1e87f5bbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b256dd2a-18d2-4ea2-b8ff-9561945a6eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b256dd2a-18d2-4ea2-b8ff-9561945a6eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a727903-9d99-4a2a-83a1-3f373241d5a6', 'volume_name': 'volume-1a727903-9d99-4a2a-83a1-3f373241d5a6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbc0dba-c900-4c99-9e75-b3132d7635dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbc0dba-c900-4c99-9e75-b3132d7635dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac86dd1-6aae-4b12-b2a4-d16bfe9f6c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume 1a727903-9d99-4a2a-83a1-3f373241d5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a727903-9d99-4a2a-83a1-3f373241d5a6', 'volume_size': 1} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" acquired by "delete_volume" :: waited 0.080s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac851d9-7936-4c9a-b273-402f1241adbf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 1073741824" returned: 0 in 0.749s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 Nov 05 08:32:57 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:57 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676963523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c3e0b-22f7-46b7-af56-e7c530037eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:56Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume 1d3c3e0b-22f7-46b7-af56-e7c530037eb1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:57 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 1073741824 Nov 05 08:32:57 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07edabd-eb0c-4e3c-80ed-6f569a2a9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a188438c-a50d-4942-a15c-e54d95986cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 (1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5): created successfully Nov 05 08:32:57 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a188438c-a50d-4942-a15c-e54d95986cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (c335e3e7-0b0d-4aa6-8906-bf88757d7e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.717s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-87e04974-c505-4fe9-8b6b-bdf3b037ce48 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:32:57 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62 Nov 05 08:32:57 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Flow 'volume_create_manager' (b14ac5e8-8b4b-463b-8fe2-aa3c858a7eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4e783c-25e0-420d-ac77-80b7aebc7cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (b7870d88-d6fa-42f9-970f-24dc53d4066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaa2652-d20c-4286-9a88-7875b19accdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4e783c-25e0-420d-ac77-80b7aebc7cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1121857520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88e8588-04f1-4e5d-bb51-f97334286b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa2f01bfd994fa2bee6f1d9abf3839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='417e764aadfa4cbc9fc5413d11f9a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2d329d-9cca-481d-85d3-9d177c0b8e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2d329d-9cca-481d-85d3-9d177c0b8e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9544b3-3f78-4325-82d4-aa5379d6e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9544b3-3f78-4325-82d4-aa5379d6e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88e8588-04f1-4e5d-bb51-f97334286b95', 'volume_name': 'volume-a88e8588-04f1-4e5d-bb51-f97334286b95', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2204e623-b152-4ec9-8846-7e1bf8013ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2204e623-b152-4ec9-8846-7e1bf8013ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d37cea-f70c-4563-9f1f-51a9efa43093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Volume a88e8588-04f1-4e5d-bb51-f97334286b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88e8588-04f1-4e5d-bb51-f97334286b95', 'volume_size': 1} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-80d2a732-c238-44dd-bea6-84a25fc88c62" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaa2652-d20c-4286-9a88-7875b19accdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720151233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5584c524-67c9-4ed4-a3aa-ca9c5e873f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3c6ffb-fda2-462e-a036-293667309b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3c6ffb-fda2-462e-a036-293667309b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c79e35-c07a-4025-82ec-4efbe7f2fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c79e35-c07a-4025-82ec-4efbe7f2fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5584c524-67c9-4ed4-a3aa-ca9c5e873f1a', 'volume_name': 'volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687e592-e59d-4549-9e5d-22f21e0c8f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687e592-e59d-4549-9e5d-22f21e0c8f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bda256b-51d6-4f5b-89b7-dbbc0f92b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume 5584c524-67c9-4ed4-a3aa-ca9c5e873f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a', 'volume_size': 1} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-80d2a732-c238-44dd-bea6-84a25fc88c62" released by "delete_volume" :: held 1.270s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:58 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 1073741824" returned: 0 in 0.633s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:58 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 Nov 05 08:32:58 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['e766b274-33dc-4d48-974b-7e29b025199f', 'e75da0eb-2829-4e9d-8dcd-4c04cd4ebb89', '762793f9-8177-4571-8a94-68c8adfee72e', 'b379b8a0-4210-4b64-ac46-5edf51cd4705'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:58 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:32:58 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665108089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a727903-9d99-4a2a-83a1-3f373241d5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:57Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume 1a727903-9d99-4a2a-83a1-3f373241d5a6 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:58 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 1073741824 Nov 05 08:32:58 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334a6bc7-b484-4867-b0f1-5cdb86f691e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fd383f-1fcd-44fb-b072-c369a9d3c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 (1d3c3e0b-22f7-46b7-af56-e7c530037eb1): created successfully Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fd383f-1fcd-44fb-b072-c369a9d3c172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (8da6f8d5-eb07-478e-b904-9dd3d339b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:58 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-492aed93-b944-4a2b-9102-27c6b1d75540 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Deleted volume successfully. Nov 05 08:32:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca1914a3-ad84-4109-ba65-652f367b1048 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-80d2a732-c238-44dd-bea6-84a25fc88c62-delete_volume" released by "delete_volume" :: held 5.755s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-531e1626-aab9-44b8-996f-fde08178a1d4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-531e1626-aab9-44b8-996f-fde08178a1d4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d7c0d-a22a-451b-9701-cdb31077989f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:59 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 1073741824" returned: 0 in 1.107s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:59 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 Nov 05 08:32:59 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:59 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 Nov 05 08:32:59 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6" returned: 0 in 0.459s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.069s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1121857520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88e8588-04f1-4e5d-bb51-f97334286b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa2f01bfd994fa2bee6f1d9abf3839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='417e764aadfa4cbc9fc5413d11f9a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Creating volume a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:00 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:00 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4" returned: 0 in 0.650s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:00 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 1073741824 Nov 05 08:33:00 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4 Nov 05 08:33:00 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac86dd1-6aae-4b12-b2a4-d16bfe9f6c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a727903-9d99-4a2a-83a1-3f373241d5a6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4f9a87-44c4-414b-8031-28721bdb8d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 (1a727903-9d99-4a2a-83a1-3f373241d5a6): created successfully Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4f9a87-44c4-414b-8031-28721bdb8d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (eae97736-03dd-45f0-ac0e-4578f4dfa9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fbb9e1df-75da-45a1-9449-9b616eb3c371 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:33:00 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-531e1626-aab9-44b8-996f-fde08178a1d4" returned: 0 in 0.382s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-quobyte-531e1626-aab9-44b8-996f-fde08178a1d4" released by "delete_volume" :: held 1.124s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:00 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Created reservations ['6b1aedef-9598-4cde-9125-8d0b40f18a9d', '8f39c29a-7df9-4115-adb2-e994670b5a21', '3f1295fc-d358-4d70-87f9-422fe626ccea', 'c2315269-2ace-4fee-8bea-01f12d7a2375'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:01 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:01 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:01 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 1073741824" returned: 0 in 0.799s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:01 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:01 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:01 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.420s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Deleted volume successfully. Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9226659-c334-469f-80ce-7186cec503c3 tempest-VolumesDeleteCascade-1700107760 None] Lock "cinder-531e1626-aab9-44b8-996f-fde08178a1d4-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:01 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.243s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720151233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5584c524-67c9-4ed4-a3aa-ca9c5e873f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec31bcc2ec9f4c86ad5497f0dab4735f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='c34b659c0e87404aa1e4e4e7ab58bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Creating volume 5584c524-67c9-4ed4-a3aa-ca9c5e873f1a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:01 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d37cea-f70c-4563-9f1f-51a9efa43093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88e8588-04f1-4e5d-bb51-f97334286b95', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:01 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a 1073741824 Nov 05 08:33:01 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f95bd90-d77c-4f8b-899d-30cb5b11006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:01 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Volume volume-a88e8588-04f1-4e5d-bb51-f97334286b95 (a88e8588-04f1-4e5d-bb51-f97334286b95): created successfully Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f95bd90-d77c-4f8b-899d-30cb5b11006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Flow 'volume_create_manager' (b14ac5e8-8b4b-463b-8fe2-aa3c858a7eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7614e9e5-292f-4f4c-bba9-1630e5d760df tempest-TestImageHashVerification-1475930218 None] Created volume successfully. Nov 05 08:33:02 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a 1073741824" returned: 0 in 0.701s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:02 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a Nov 05 08:33:02 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af55862e-5421-48f2-a8e0-f811a5a1ee1f tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" by "attach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af55862e-5421-48f2-a8e0-f811a5a1ee1f tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" acquired by "attach_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:02 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-af55862e-5421-48f2-a8e0-f811a5a1ee1f tempest-VolumesActionsTest-1320477972 None] Attaching volume 5185429b-cb68-4369-97f3-66a2a7fd7d38 to instance 90846187-5fc9-4aae-9d59-60859a3410bb at mountpoint /dev/vdb on host None. Nov 05 08:33:02 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-af55862e-5421-48f2-a8e0-f811a5a1ee1f tempest-VolumesActionsTest-1320477972 None] Attach volume completed successfully. Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af55862e-5421-48f2-a8e0-f811a5a1ee1f tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38" released by "attach_volume" :: held 0.179s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:02 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" returned: 0 in 0.540s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bda256b-51d6-4f5b-89b7-dbbc0f92b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a46de-7d38-4522-a33b-bf7686c2e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:03 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Volume volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a (5584c524-67c9-4ed4-a3aa-ca9c5e873f1a): created successfully Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a46de-7d38-4522-a33b-bf7686c2e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Flow 'volume_create_manager' (b7870d88-d6fa-42f9-970f-24dc53d4066e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-81a36cc5-043e-4066-b93a-a55f414f5d86 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created volume successfully. Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2c6ce-1a14-4313-a551-360543b097ae]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10571bb1-c38a-4043-9994-6c999d62e51b tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" by "detach_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10571bb1-c38a-4043-9994-6c999d62e51b tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-10571bb1-c38a-4043-9994-6c999d62e51b tempest-VolumesActionsTest-1320477972 None] Detaching volume 5185429b-cb68-4369-97f3-66a2a7fd7d38 from instance 90846187-5fc9-4aae-9d59-60859a3410bb. Nov 05 08:33:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-10571bb1-c38a-4043-9994-6c999d62e51b tempest-VolumesActionsTest-1320477972 None] Detach volume completed successfully. Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10571bb1-c38a-4043-9994-6c999d62e51b tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:03 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:03 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d3bed-1edd-4115-8c6c-a6ac0d121206]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:04 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.675s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b6a85-eb21-4911-bebc-1fcdf5ebbc74]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:04 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a Nov 05 08:33:04 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:04 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:04 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:04 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" returned: 0 in 0.733s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:04 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a Nov 05 08:33:04 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:05 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.696s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 /opt/stack/data/cinder/conversion/a88e8588-04f1-4e5d-bb51-f97334286b95.temp_image.08f135fc-2fb6-4655-a160-226cc35ba8e58r08emt2.img {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:05 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 /opt/stack/data/cinder/conversion/a88e8588-04f1-4e5d-bb51-f97334286b95.temp_image.08f135fc-2fb6-4655-a160-226cc35ba8e58r08emt2.img Nov 05 08:33:05 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:05 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" returned: 0 in 0.375s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a" released by "delete_volume" :: held 1.193s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['3b867d00-5649-47af-a75c-c4b1826db7e0', '599a6a85-2a32-4d7f-8798-60bf9716e539', 'ddb629df-7807-4bf3-8950-ffb038e09046', '69912c7d-744c-4af6-96e1-c88d82337e4b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:05 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:05 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:06 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.695s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61bc8539-1598-4560-9f26-74c9142f0f63 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-5584c524-67c9-4ed4-a3aa-ca9c5e873f1a-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-1a727903-9d99-4a2a-83a1-3f373241d5a6-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1a727903-9d99-4a2a-83a1-3f373241d5a6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-1a727903-9d99-4a2a-83a1-3f373241d5a6" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1a727903-9d99-4a2a-83a1-3f373241d5a6" acquired by "delete_volume" :: waited 0.068s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864170c-e9ad-4214-be9c-a870c52cad05]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:06 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 Nov 05 08:33:06 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:07 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6" returned: 0 in 0.773s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:07 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6 Nov 05 08:33:07 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:08 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1a727903-9d99-4a2a-83a1-3f373241d5a6" returned: 0 in 0.711s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1a727903-9d99-4a2a-83a1-3f373241d5a6" released by "delete_volume" :: held 1.641s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['13f19d3c-0d59-470f-ac2f-0321658ff88d', '4bd8b7ae-b507-46c6-833a-f25ea7bf9500', '25ef0113-d151-447e-a3cb-5547e958f42b', 'f249b619-7fd1-433b-afd9-334b9cea87ed'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:08 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:08 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-1d3c3e0b-22f7-46b7-af56-e7c530037eb1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1d3c3e0b-22f7-46b7-af56-e7c530037eb1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:09 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.680s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[04071b4d-bb4c-4b8b-a9ff-f0bde71f2773]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-61777ceb-9de0-4f57-a36b-283163f86dcb tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1a727903-9d99-4a2a-83a1-3f373241d5a6-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:09 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 Nov 05 08:33:09 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:10 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" returned: 0 in 0.994s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:10 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1 Nov 05 08:33:10 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:10 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" returned: 0 in 0.487s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1d3c3e0b-22f7-46b7-af56-e7c530037eb1" released by "delete_volume" :: held 1.610s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['f702a78c-a69a-4a88-aa99-9b92b03f8b1d', '9d07dd21-39eb-43c2-803c-a17da76a8c53', 'cc831fe8-0b34-4e0f-87ee-e20c553e5d98', '4373156e-564f-43f8-b003-9a18a7eb7e6d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:11 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:11 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:11 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.626s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d9247065-c2e9-4166-a9ca-aa632883140d tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1d3c3e0b-22f7-46b7-af56-e7c530037eb1-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba602b47-9c7f-4bde-9397-e87166a48b05]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:11 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 Nov 05 08:33:11 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:12 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" returned: 0 in 0.643s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:12 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5 Nov 05 08:33:12 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:12 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" returned: 0 in 0.553s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5" released by "delete_volume" :: held 1.318s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Flow 'volume_create_manager' (c6e98a63-8769-45ad-8070-ac21b9c1ef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b138fa6f-2d67-4bd3-87b4-a6cf4aac1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b138fa6f-2d67-4bd3-87b4-a6cf4aac1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1340583287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c6e056-f87d-4fd8-bf29-ce6b512a9efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f45b218dea449cb62e776f1861dd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:13Z,use_quota=True,user_id='b0bb46279a1449b7ab0f9c02998f8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2b11bb-da3c-4e80-a701-d5fbf1f55543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2b11bb-da3c-4e80-a701-d5fbf1f55543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77896f2b-f20e-4967-8240-af9f9b3d1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77896f2b-f20e-4967-8240-af9f9b3d1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c6e056-f87d-4fd8-bf29-ce6b512a9efd', 'volume_name': 'volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c20ff29-68f5-4628-b7a6-b6de29c7b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c20ff29-68f5-4628-b7a6-b6de29c7b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec514821-8fed-4004-bf7b-10886272a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Volume 03c6e056-f87d-4fd8-bf29-ce6b512a9efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd', 'volume_size': 1} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['df4d16e9-24e6-4fd8-813b-49c28ee01a33', '17752c90-7fb9-46e8-8ece-c0f0fd87fced', '5866b621-b5e0-4d05-ad8b-02d7e048e1d4', 'e1c7a77d-861a-4eb0-b77f-754f75c561db'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:13 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:13 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:13 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.477s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-98497ac8-853e-49e7-97b3-ae56538b495f tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-1eb0ab25-c1f3-4df6-b157-eccc23d0ecb5-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-86675419-8305-4cb1-b0a6-5570ebffe3fb-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-86675419-8305-4cb1-b0a6-5570ebffe3fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-86675419-8305-4cb1-b0a6-5570ebffe3fb" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-86675419-8305-4cb1-b0a6-5570ebffe3fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:14 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 /opt/stack/data/cinder/conversion/a88e8588-04f1-4e5d-bb51-f97334286b95.temp_image.08f135fc-2fb6-4655-a160-226cc35ba8e58r08emt2.img" returned: 0 in 8.977s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5e57e-aed2-4843-9a8c-d51b86918238]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b7e61-5022-43a8-bb29-a610b5408180]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:14 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb Nov 05 08:33:14 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:14 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:14 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:14 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:14 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb Nov 05 08:33:14 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:14 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.526s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/conversion/a88e8588-04f1-4e5d-bb51-f97334286b95.temp_image.08f135fc-2fb6-4655-a160-226cc35ba8e58r08emt2.img {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:33:14 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Converted 1024.00 MB image at 114.05 MB/s Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] 08f135fc-2fb6-4655-a160-226cc35ba8e5 was raw, no need to convert to raw {{(pid=87101) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 08:33:14 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86675419-8305-4cb1-b0a6-5570ebffe3fb" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-86675419-8305-4cb1-b0a6-5570ebffe3fb" released by "delete_volume" :: held 0.650s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['7aa1e1d8-d459-4277-9835-ee620cb1f56e', 'b7dde47d-7600-43d4-b807-e0bdf002407f', '60647965-29a7-4d0a-aebf-1ead6dc332de', '50bc27aa-429d-461c-ac06-70f78d8c3508'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:14 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:14 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:15 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-48c04295-148b-4770-9735-8274a15b5013 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-86675419-8305-4cb1-b0a6-5570ebffe3fb-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-df7aa2b8-c152-431d-a5bf-f7356bbd812a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-df7aa2b8-c152-431d-a5bf-f7356bbd812a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "cinder-quobyte-df7aa2b8-c152-431d-a5bf-f7356bbd812a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-df7aa2b8-c152-431d-a5bf-f7356bbd812a" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b183779-bb86-416b-8f81-6686771632f9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:15 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a Nov 05 08:33:15 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:15 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a" returned: 0 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:15 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a Nov 05 08:33:15 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:15 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-df7aa2b8-c152-431d-a5bf-f7356bbd812a" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-quobyte-df7aa2b8-c152-431d-a5bf-f7356bbd812a" released by "delete_volume" :: held 0.668s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:15 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Created reservations ['692d063a-0520-4005-bd60-d4d3deb3e4a6', '92d554bf-789b-4f2d-8966-3c039c09cd17', '31641584-956c-43a7-b09c-0baf0d1079d5', 'fda0e744-1aba-43d8-9b61-59ae3fdc9566'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:16 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:16 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:16 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:16 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Deleted volume successfully. Nov 05 08:33:16 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-34eaa651-cddc-44b0-a227-6840e8016ff0 tempest-CreateVolumesFromSourceVolumeTest-1719908902 None] Lock "cinder-df7aa2b8-c152-431d-a5bf-f7356bbd812a-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Flow 'volume_create_manager' (a21f88bd-7246-4c57-b688-b843d060aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9e0aa5-8d90-4e07-a15d-960295ff0cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9e0aa5-8d90-4e07-a15d-960295ff0cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745888561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272b76af-a76e-4779-b340-8f697d369bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf210e7689e4a149ca6807185bbf37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:20Z,use_quota=True,user_id='886381540581460c82aaee526e7e77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df57ad53-9a27-4989-8627-b545d6e64f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df57ad53-9a27-4989-8627-b545d6e64f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb96922-8d90-4907-8a31-cdb0cbd0876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb96922-8d90-4907-8a31-cdb0cbd0876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272b76af-a76e-4779-b340-8f697d369bd7', 'volume_name': 'volume-272b76af-a76e-4779-b340-8f697d369bd7', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8fb50-663e-45a1-a361-4c25dd97ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8fb50-663e-45a1-a361-4c25dd97ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c2eeb8-5b32-4283-848c-1eed4ae9f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Volume 272b76af-a76e-4779-b340-8f697d369bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272b76af-a76e-4779-b340-8f697d369bd7', 'volume_size': 1} Nov 05 08:33:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:30 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=79,cinder:UPDATE=94,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:33:30 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=74,cinder:UPDATE=105,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.860s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Uploaded volume to glance image-id: 08f135fc-2fb6-4655-a160-226cc35ba8e5. {{(pid=87101) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 22.678s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96ac740-6e51-4c3b-957c-28bada0b2b62]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-29a16b1b-358f-4152-9161-47020bfced94 tempest-TestImageHashVerification-1475930218 None] Copy volume to image completed successfully. Nov 05 08:33:34 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:33:34 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:34 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.350s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a3392-a777-4767-947b-75c6c58beb81]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:35 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:33:35 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:35 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.b6c872e4-b4ed-40c2-b777-95d3783344daqvfk6asl.img {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:35 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.b6c872e4-b4ed-40c2-b777-95d3783344daqvfk6asl.img Nov 05 08:33:35 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Acquiring lock "cinder-a88e8588-04f1-4e5d-bb51-f97334286b95-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "cinder-a88e8588-04f1-4e5d-bb51-f97334286b95-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Acquiring lock "cinder-quobyte-a88e8588-04f1-4e5d-bb51-f97334286b95" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "cinder-quobyte-a88e8588-04f1-4e5d-bb51-f97334286b95" acquired by "delete_volume" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0da3a2-ad7d-47ed-8308-3e48e266df56]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:36 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:36 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:36 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.648s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:36 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95 Nov 05 08:33:36 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:37 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a88e8588-04f1-4e5d-bb51-f97334286b95" returned: 0 in 0.435s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "cinder-quobyte-a88e8588-04f1-4e5d-bb51-f97334286b95" released by "delete_volume" :: held 1.167s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Created reservations ['4d2f576b-52f6-400b-8ddc-f19ce066a9da', '2692ee24-c450-4b20-ae10-af4cb6ffc278', '3c8c6a7a-5b14-4689-9d1b-6ac95d11c094', 'f8340e65-0f4e-40f4-8b5f-94f872604dd0'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:37 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:37 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:37 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.302s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:37 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Deleted volume successfully. Nov 05 08:33:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a50bc33-130f-455d-8dbd-1738b6cb3ddb tempest-TestImageHashVerification-1475930218 None] Lock "cinder-a88e8588-04f1-4e5d-bb51-f97334286b95-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:42 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.b6c872e4-b4ed-40c2-b777-95d3783344daqvfk6asl.img" returned: 0 in 6.852s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7920e2-e583-429e-b039-af73c18cf984]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:42 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:33:42 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:42 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.555s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.b6c872e4-b4ed-40c2-b777-95d3783344daqvfk6asl.img {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:33:42 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Converted 1024.00 MB image at 149.43 MB/s Nov 05 08:33:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] b6c872e4-b4ed-40c2-b777-95d3783344da was raw, no need to convert to raw {{(pid=87101) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:48 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:33:48 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:48 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:33:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:33:52 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:33:52 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.949s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Uploaded volume to glance image-id: b6c872e4-b4ed-40c2-b777-95d3783344da. {{(pid=87101) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 51.284s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1340583287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c6e056-f87d-4fd8-bf29-ce6b512a9efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f45b218dea449cb62e776f1861dd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:13Z,use_quota=True,user_id='b0bb46279a1449b7ab0f9c02998f8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Creating volume 03c6e056-f87d-4fd8-bf29-ce6b512a9efd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:04 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:04 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd 1073741824 Nov 05 08:34:04 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2323a12e-4275-420b-a300-02e1111cf589 tempest-VolumesActionsTest-1320477972 None] Copy volume to image completed successfully. Nov 05 08:34:04 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd 1073741824" returned: 0 in 0.500s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:05 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd Nov 05 08:34:05 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:05 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 44.874s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745888561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272b76af-a76e-4779-b340-8f697d369bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf210e7689e4a149ca6807185bbf37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:20Z,use_quota=True,user_id='886381540581460c82aaee526e7e77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Creating volume 272b76af-a76e-4779-b340-8f697d369bd7 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:05 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec514821-8fed-4004-bf7b-10886272a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c18052-5976-466d-8605-fc8f18b53d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:05 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 1073741824 Nov 05 08:34:05 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Volume volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd (03c6e056-f87d-4fd8-bf29-ce6b512a9efd): created successfully Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c18052-5976-466d-8605-fc8f18b53d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Flow 'volume_create_manager' (c6e98a63-8769-45ad-8070-ac21b9c1ef98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0501d8ea-1cf2-4af2-b5ab-c7daf8835a9e tempest-VolumesTransfersV357Test-288240008 None] Created volume successfully. Nov 05 08:34:05 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 1073741824" returned: 0 in 0.634s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:06 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 Nov 05 08:34:06 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:06 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7" returned: 0 in 0.287s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.143s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c2eeb8-5b32-4283-848c-1eed4ae9f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272b76af-a76e-4779-b340-8f697d369bd7', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0174bb-77ac-4712-bcd2-bd26ba9da146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d70eb-c180-4695-a1c4-b32ceebb7a8e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:06 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Volume volume-272b76af-a76e-4779-b340-8f697d369bd7 (272b76af-a76e-4779-b340-8f697d369bd7): created successfully Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0174bb-77ac-4712-bcd2-bd26ba9da146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Flow 'volume_create_manager' (a21f88bd-7246-4c57-b688-b843d060aff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2a55f033-84e3-4f5b-8a19-6f1aa149c006 tempest-ProjectReaderTests-929763287 None] Created volume successfully. Nov 05 08:34:06 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:34:06 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:06 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.476s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d751432-c7a8-4539-8d71-d9ce66a56042]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Acquiring lock "cinder-272b76af-a76e-4779-b340-8f697d369bd7-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:06 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:34:06 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "cinder-272b76af-a76e-4779-b340-8f697d369bd7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Acquiring lock "cinder-quobyte-272b76af-a76e-4779-b340-8f697d369bd7" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-073fb242-87c6-48ff-8223-97bd43d6512a tempest-VolumesTransfersV357Test-1352836393 None] Transfer volume completed successfully. Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "cinder-quobyte-272b76af-a76e-4779-b340-8f697d369bd7" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eff7cd-9ca7-4725-97cf-4907e7464c9a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:07 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 Nov 05 08:34:07 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:07 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.591s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:07 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img Nov 05 08:34:07 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:07 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7" returned: 0 in 0.480s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:07 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7 Nov 05 08:34:07 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "cinder-03c6e056-f87d-4fd8-bf29-ce6b512a9efd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-03c6e056-f87d-4fd8-bf29-ce6b512a9efd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "cinder-quobyte-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-quobyte-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" acquired by "delete_volume" :: waited 0.042s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d133dbd-42dc-4875-a165-166eed0c689d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:08 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-272b76af-a76e-4779-b340-8f697d369bd7" returned: 0 in 0.416s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "cinder-quobyte-272b76af-a76e-4779-b340-8f697d369bd7" released by "delete_volume" :: held 0.979s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:08 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd Nov 05 08:34:08 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Created reservations ['8667fe0a-f62c-4470-b960-441ec8226c16', '5af45d9a-3695-4d42-aba3-817b7872f084', '69d6ba04-f335-4c85-88ef-b3b77d37107d', 'db7d2541-3f93-4d7b-be20-c1b1ef0fd386'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:08 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:08 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:08 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" returned: 0 in 0.596s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:08 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd Nov 05 08:34:08 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:08 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Deleted volume successfully. Nov 05 08:34:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-93cf3d80-5269-45eb-81ac-ebfca9bc39df tempest-ProjectReaderTests-929763287 None] Lock "cinder-272b76af-a76e-4779-b340-8f697d369bd7-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:09 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" returned: 0 in 0.752s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-quobyte-03c6e056-f87d-4fd8-bf29-ce6b512a9efd" released by "delete_volume" :: held 1.495s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Created reservations ['050806b1-4766-4977-b3eb-a9d5c0fe4f8c', 'b78b82eb-f264-4ecc-9129-cf0f9528e7ed', 'c0834d9b-8d70-453e-b001-c59c30e6bb78', '50acd43d-b12f-4e0f-a74b-8dddf5ddd9e9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:09 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:09 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:10 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.490s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Deleted volume successfully. Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b0389b05-59e3-4e0c-b99d-29908393429f tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-03c6e056-f87d-4fd8-bf29-ce6b512a9efd-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Flow 'volume_create_manager' (3501eb06-d006-40aa-9d3d-a94497fd53b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd4d750-2813-44cc-9c93-f8af0e35663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd4d750-2813-44cc-9c93-f8af0e35663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-641525729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e730f7-0ed2-4a97-a723-8f75609af516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf210e7689e4a149ca6807185bbf37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:10Z,use_quota=True,user_id='886381540581460c82aaee526e7e77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b47647-da5b-4d82-b638-a54c6ce6f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b47647-da5b-4d82-b638-a54c6ce6f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b8bfc8-c070-4c9f-b81d-f1d1c3868b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b8bfc8-c070-4c9f-b81d-f1d1c3868b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e730f7-0ed2-4a97-a723-8f75609af516', 'volume_name': 'volume-81e730f7-0ed2-4a97-a723-8f75609af516', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124b595-9c80-4889-b2b0-3c3d5771f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124b595-9c80-4889-b2b0-3c3d5771f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d30a9cc-174c-4235-9975-f6960b723490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Volume 81e730f7-0ed2-4a97-a723-8f75609af516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e730f7-0ed2-4a97-a723-8f75609af516', 'volume_size': 1} Nov 05 08:34:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Flow 'volume_create_manager' (adcd1bcc-3a03-43a8-baaa-ec797b1d3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d28633d-2829-4c33-92b4-1a783398a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d28633d-2829-4c33-92b4-1a783398a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1244557518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e445086-a5a1-48f2-8557-b8bc88c872e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f45b218dea449cb62e776f1861dd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:12Z,use_quota=True,user_id='b0bb46279a1449b7ab0f9c02998f8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f0be48-a70d-4a41-aeea-05ce3891ee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f0be48-a70d-4a41-aeea-05ce3891ee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc51a1cc-2c31-4a0a-8253-b6222190f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc51a1cc-2c31-4a0a-8253-b6222190f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e445086-a5a1-48f2-8557-b8bc88c872e0', 'volume_name': 'volume-7e445086-a5a1-48f2-8557-b8bc88c872e0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02aa1ae9-fc02-46a2-ae00-1c5f065d4a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02aa1ae9-fc02-46a2-ae00-1c5f065d4a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d4715c-8364-4b3e-81d2-3df3b9511760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:12 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Volume 7e445086-a5a1-48f2-8557-b8bc88c872e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e445086-a5a1-48f2-8557-b8bc88c872e0', 'volume_size': 1} Nov 05 08:34:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:15 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img" returned: 0 in 8.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f7756-c6cd-42f0-9464-bbc86a48f381]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:15 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:34:15 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:16 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.553s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:16 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Converted 1024.00 MB image at 122.74 MB/s Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] 2c41b7cf-2160-4852-bf6c-573638fbdd74 was raw, converting to qcow2 {{(pid=87101) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c05f51-8fee-4cc2-a19c-01895e6ce696]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:16 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img Nov 05 08:34:16 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:16 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:16 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img Nov 05 08:34:16 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:17 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img" returned: 1 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img /opt/stack/data/cinder/conversion/vol_upload_h095p5bz {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:17 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img /opt/stack/data/cinder/conversion/vol_upload_h095p5bz Nov 05 08:34:17 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:17 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img /opt/stack/data/cinder/conversion/vol_upload_h095p5bz" returned: 0 in 0.260s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Image conversion details: src /opt/stack/data/cinder/conversion/5185429b-cb68-4369-97f3-66a2a7fd7d38.temp_image.2c41b7cf-2160-4852-bf6c-573638fbdd744c4q8iaz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h095p5bz {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:17 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc84c8-4bed-4a70-98c7-1f432e1b225e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h095p5bz {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:17 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h095p5bz Nov 05 08:34:17 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:17 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h095p5bz" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.772s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Uploaded volume to glance image-id: 2c41b7cf-2160-4852-bf6c-573638fbdd74. {{(pid=87101) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.424s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-641525729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e730f7-0ed2-4a97-a723-8f75609af516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf210e7689e4a149ca6807185bbf37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:10Z,use_quota=True,user_id='886381540581460c82aaee526e7e77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Creating volume 81e730f7-0ed2-4a97-a723-8f75609af516 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:19 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:19 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 1073741824 Nov 05 08:34:19 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c67b9fbc-b60e-40ae-ba49-889eee7ad887 tempest-VolumesActionsTest-1320477972 None] Copy volume to image completed successfully. Nov 05 08:34:19 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 1073741824" returned: 0 in 0.545s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:19 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 Nov 05 08:34:19 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:19 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516" returned: 0 in 0.264s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.644s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1244557518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e445086-a5a1-48f2-8557-b8bc88c872e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f45b218dea449cb62e776f1861dd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:12Z,use_quota=True,user_id='b0bb46279a1449b7ab0f9c02998f8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Creating volume 7e445086-a5a1-48f2-8557-b8bc88c872e0 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:19 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d30a9cc-174c-4235-9975-f6960b723490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e730f7-0ed2-4a97-a723-8f75609af516', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:19 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 1073741824 Nov 05 08:34:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b02bdd7-5aea-4267-944e-3d46112d4d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:19 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:19 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Volume volume-81e730f7-0ed2-4a97-a723-8f75609af516 (81e730f7-0ed2-4a97-a723-8f75609af516): created successfully Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b02bdd7-5aea-4267-944e-3d46112d4d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Flow 'volume_create_manager' (3501eb06-d006-40aa-9d3d-a94497fd53b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4493c460-d25a-4a86-91fc-7152160ed3c4 tempest-ProjectReaderTests-929763287 None] Created volume successfully. Nov 05 08:34:20 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 1073741824" returned: 0 in 0.578s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:20 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 Nov 05 08:34:20 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:20 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0" returned: 0 in 0.287s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d4715c-8364-4b3e-81d2-3df3b9511760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e445086-a5a1-48f2-8557-b8bc88c872e0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eafcbb-a934-4c0a-89e9-732f1d26e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Volume volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 (7e445086-a5a1-48f2-8557-b8bc88c872e0): created successfully Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eafcbb-a934-4c0a-89e9-732f1d26e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Flow 'volume_create_manager' (adcd1bcc-3a03-43a8-baaa-ec797b1d3342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "cinder-quobyte-5185429b-cb68-4369-97f3-66a2a7fd7d38" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9338144f-1d02-45e6-ba2a-9a6006316341 tempest-VolumesTransfersV357Test-288240008 None] Created volume successfully. Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-quobyte-5185429b-cb68-4369-97f3-66a2a7fd7d38" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3f64d-0bdb-426f-9e9b-eee848e11191]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Acquiring lock "cinder-81e730f7-0ed2-4a97-a723-8f75609af516-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "cinder-81e730f7-0ed2-4a97-a723-8f75609af516-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Acquiring lock "cinder-quobyte-81e730f7-0ed2-4a97-a723-8f75609af516" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "cinder-quobyte-81e730f7-0ed2-4a97-a723-8f75609af516" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f22f2ff-b5ac-4371-bdd9-86d848d38cc1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:21 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:21 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:21 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 Nov 05 08:34:21 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:21 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.437s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:21 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38 Nov 05 08:34:21 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:21 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:21 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516 Nov 05 08:34:21 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:21 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-5185429b-cb68-4369-97f3-66a2a7fd7d38" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-quobyte-5185429b-cb68-4369-97f3-66a2a7fd7d38" released by "delete_volume" :: held 0.813s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Created reservations ['5afb70c7-3f74-4358-98f5-8d979225861d', 'b5628327-1d3a-456c-9de4-a71ea35d06d2', '0c67f724-d7d2-4cf1-a17c-aa2d38f8a32a', 'a9dd0d16-3599-4ef9-bee6-82878d6a5e3a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:21 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81e730f7-0ed2-4a97-a723-8f75609af516" returned: 0 in 0.347s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "cinder-quobyte-81e730f7-0ed2-4a97-a723-8f75609af516" released by "delete_volume" :: held 0.829s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:22 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:22 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Created reservations ['69226b52-9e96-431b-ab68-f08e0c4e4ab6', 'fdb91df7-f20d-4471-87a0-ef1d61c74d57', 'b7ec183e-ccb2-4f9a-ba10-c53c4b6b6c9a', 'cf47751a-4dad-4886-b2cf-d0a620f2c556'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "cinder-7e445086-a5a1-48f2-8557-b8bc88c872e0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-7e445086-a5a1-48f2-8557-b8bc88c872e0-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "cinder-quobyte-7e445086-a5a1-48f2-8557-b8bc88c872e0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-quobyte-7e445086-a5a1-48f2-8557-b8bc88c872e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:22 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914baec-6403-411b-892b-049ed6702e0e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Deleted volume successfully. Nov 05 08:34:22 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:22 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b9dc41b7-96f6-4534-baed-d6b7b4005a60 tempest-VolumesActionsTest-1320477972 None] Lock "cinder-5185429b-cb68-4369-97f3-66a2a7fd7d38-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:22 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 Nov 05 08:34:22 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:22 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.364s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Deleted volume successfully. Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a40e5918-bbde-4efe-a5fc-e9f8eeb88ef2 tempest-ProjectReaderTests-929763287 None] Lock "cinder-81e730f7-0ed2-4a97-a723-8f75609af516-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:22 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0" returned: 0 in 0.602s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:23 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0 Nov 05 08:34:23 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:23 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7e445086-a5a1-48f2-8557-b8bc88c872e0" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-quobyte-7e445086-a5a1-48f2-8557-b8bc88c872e0" released by "delete_volume" :: held 1.052s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Created reservations ['a37f99ec-9d18-4c3b-869a-ba7d3616f62d', '213f9017-4afc-4ae0-bc13-b3dda3b33ff8', 'd63c45ce-7509-42b1-9b40-d05478a5dda3', 'cd1c75ab-87ff-46bb-856a-bd7056df844e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:23 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:23 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Flow 'volume_create_manager' (0eb5ce37-4810-42c4-bac7-f7895d20098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfed1788-9fb7-458d-9155-c48ac6927641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfed1788-9fb7-458d-9155-c48ac6927641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-501455012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeb2124-a381-4ac7-be30-571667dafc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37492383b2f34f2393ca7ce7e89ba812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:24Z,use_quota=True,user_id='278949903ace4371853e8dbdcae012ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e812dcbd-ed82-4848-9fd1-a2ca2b2fc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e812dcbd-ed82-4848-9fd1-a2ca2b2fc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44af42a-a564-491a-9bf5-822a40e300dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44af42a-a564-491a-9bf5-822a40e300dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeb2124-a381-4ac7-be30-571667dafc48', 'volume_name': 'volume-2eeb2124-a381-4ac7-be30-571667dafc48', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09b0ae0-6b5b-4b3a-9e04-39f2cf2651b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09b0ae0-6b5b-4b3a-9e04-39f2cf2651b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b909f272-5895-4956-a439-639506801049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:23 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Volume 2eeb2124-a381-4ac7-be30-571667dafc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeb2124-a381-4ac7-be30-571667dafc48', 'volume_size': 1} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-501455012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeb2124-a381-4ac7-be30-571667dafc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37492383b2f34f2393ca7ce7e89ba812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:24Z,use_quota=True,user_id='278949903ace4371853e8dbdcae012ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Creating volume 2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:23 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:23 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 1073741824 Nov 05 08:34:23 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:23 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.308s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Deleted volume successfully. Nov 05 08:34:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4fb81c58-e271-40e4-b522-b4615f1a5eea tempest-VolumesTransfersV357Test-920574032 None] Lock "cinder-7e445086-a5a1-48f2-8557-b8bc88c872e0-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:24 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 1073741824" returned: 0 in 0.570s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:24 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:34:24 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:24 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.331s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b909f272-5895-4956-a439-639506801049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeb2124-a381-4ac7-be30-571667dafc48', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fc186c-e299-4927-b09c-ae2d34a573a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:24 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Volume volume-2eeb2124-a381-4ac7-be30-571667dafc48 (2eeb2124-a381-4ac7-be30-571667dafc48): created successfully Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fc186c-e299-4927-b09c-ae2d34a573a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Flow 'volume_create_manager' (0eb5ce37-4810-42c4-bac7-f7895d20098c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b046d209-ae49-4152-9455-c5ba1c07f489 tempest-TestStampPattern-1233313966 None] Created volume successfully. Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Flow 'volume_create_manager' (645cc8ad-32f1-4908-876f-1c53af9c3e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49e1f5-ccc3-4ddd-88d2-15467b9a861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49e1f5-ccc3-4ddd-88d2-15467b9a861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535977423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c5bf7-9ab3-4797-9042-75f4248107d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f613b06a8547c9800e9eb541f9d3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:34Z,use_quota=True,user_id='f57fc373a3f94428ae3667fa4b45e492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4fa3bc-f541-492a-8e3c-e68192e766e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4fa3bc-f541-492a-8e3c-e68192e766e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a728f5ed-44b4-4681-a08a-3f746e8772f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a728f5ed-44b4-4681-a08a-3f746e8772f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96c5bf7-9ab3-4797-9042-75f4248107d3', 'volume_name': 'volume-f96c5bf7-9ab3-4797-9042-75f4248107d3', 'volume_size': 2}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4e8c5f-eb98-4837-bb81-3000ef5ded29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4e8c5f-eb98-4837-bb81-3000ef5ded29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab971f1-9056-45fc-bc92-fa653efc1884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Volume f96c5bf7-9ab3-4797-9042-75f4248107d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96c5bf7-9ab3-4797-9042-75f4248107d3', 'volume_size': 2} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535977423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c5bf7-9ab3-4797-9042-75f4248107d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f613b06a8547c9800e9eb541f9d3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:34Z,use_quota=True,user_id='f57fc373a3f94428ae3667fa4b45e492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Creating volume f96c5bf7-9ab3-4797-9042-75f4248107d3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:34 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 2147483648 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:34 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 2147483648 Nov 05 08:34:34 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:34 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 2147483648" returned: 0 in 0.719s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:34 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 Nov 05 08:34:34 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:35 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab971f1-9056-45fc-bc92-fa653efc1884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96c5bf7-9ab3-4797-9042-75f4248107d3', 'volume_size': 2}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb4a4cd-68ed-4eb1-8cb7-518d5f095d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Volume volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 (f96c5bf7-9ab3-4797-9042-75f4248107d3): created successfully Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb4a4cd-68ed-4eb1-8cb7-518d5f095d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Flow 'volume_create_manager' (645cc8ad-32f1-4908-876f-1c53af9c3e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-93f642bd-ba96-401b-bea7-6754e7d7c127 tempest-VolumesCloneNegativeTest-1815310670 None] Created volume successfully. Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Flow 'volume_create_manager' (14eccb9b-1262-406b-9264-45b6367fd453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0fe65d-11e8-4005-84ce-df633f4206c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0fe65d-11e8-4005-84ce-df633f4206c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-235162209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4505c13-797e-4d0b-b2ff-5fbce3438369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68494d2a55b24f559a08d26a0df8867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:36Z,use_quota=True,user_id='259fa5f17c1b442abb6b5d588a9b9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6460ca-535d-4b72-a20b-8f474ffe0449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6460ca-535d-4b72-a20b-8f474ffe0449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bbee19-f727-488d-ad4b-7f60e12b386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bbee19-f727-488d-ad4b-7f60e12b386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4505c13-797e-4d0b-b2ff-5fbce3438369', 'volume_name': 'volume-f4505c13-797e-4d0b-b2ff-5fbce3438369', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18f94e5-28c2-4ae4-afd0-7603dba788ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18f94e5-28c2-4ae4-afd0-7603dba788ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39814b3-dc20-493c-bd92-1c1e89f44d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:36 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Volume f4505c13-797e-4d0b-b2ff-5fbce3438369: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4505c13-797e-4d0b-b2ff-5fbce3438369', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Trying to clone f4505c13-797e-4d0b-b2ff-5fbce3438369 from image 0f972b89-5809-49af-bb61-4f969e240750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Acquiring lock "cinder-f96c5bf7-9ab3-4797-9042-75f4248107d3-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "cinder-f96c5bf7-9ab3-4797-9042-75f4248107d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Acquiring lock "cinder-quobyte-f96c5bf7-9ab3-4797-9042-75f4248107d3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "cinder-quobyte-f96c5bf7-9ab3-4797-9042-75f4248107d3" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe4f187-9049-4eac-8428-a62e5563bd88]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:36 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 Nov 05 08:34:36 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:34:36 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ae72c-153a-451d-9f45-96bb95c0802c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:37 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD Nov 05 08:34:37 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:37 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3" returned: 0 in 0.559s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:37 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3 Nov 05 08:34:37 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:37 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 is fetched for user 259fa5f17c1b442abb6b5d588a9b9d8c. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:34:37 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f96c5bf7-9ab3-4797-9042-75f4248107d3" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8d86f9-b65c-418a-b91c-44467796fd8a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "cinder-quobyte-f96c5bf7-9ab3-4797-9042-75f4248107d3" released by "delete_volume" :: held 0.936s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Created reservations ['061e5329-9a9a-4ae0-87f2-29cbdb90f6ef', 'a7b93d2b-1efc-4d95-8490-95814cd6c6c2', '88aa1389-1776-4533-b8bf-0063029ac08a', '5ad31ad9-2c0e-44ab-8937-7eb503c05565'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:37 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD Nov 05 08:34:37 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:37 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:37 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:37 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-235162209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4505c13-797e-4d0b-b2ff-5fbce3438369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68494d2a55b24f559a08d26a0df8867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:36Z,use_quota=True,user_id='259fa5f17c1b442abb6b5d588a9b9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Creating volume f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:37 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:37 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1073741824 Nov 05 08:34:37 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:37 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.310s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:37 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Deleted volume successfully. Nov 05 08:34:37 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7d1e950f-009e-46c5-a649-9d9354f6685f tempest-VolumesCloneNegativeTest-1815310670 None] Lock "cinder-f96c5bf7-9ab3-4797-9042-75f4248107d3-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:38 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1073741824" returned: 0 in 0.472s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:38 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 Nov 05 08:34:38 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:38 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Attempting download of 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume f4505c13-797e-4d0b-b2ff-5fbce3438369. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[500beae0-627b-47c4-a632-0fb91ce04a63]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:38 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f Nov 05 08:34:38 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:39 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f" returned: 0 in 0.475s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:39 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f Nov 05 08:34:39 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:39 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f" returned: 1 in 0.394s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_f6tqmf3f' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[37190706-bd47-4dc5-971f-24aa832fe2c0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:39 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD Nov 05 08:34:39 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:40 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] 0f972b89-5809-49af-bb61-4f969e240750 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:34:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:40 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 Nov 05 08:34:40 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:42 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369" returned: 0 in 2.233s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_uvo2j9iidevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:42 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Converted 112.00 MB image at 50.13 MB/s Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:42 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1G Nov 05 08:34:42 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:42 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 1G" returned: 0 in 0.347s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Downloaded image 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume f4505c13-797e-4d0b-b2ff-5fbce3438369 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 for user 259fa5f17c1b442abb6b5d588a9b9d8c is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Marking volume f4505c13-797e-4d0b-b2ff-5fbce3438369 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Copying metadata from image 0f972b89-5809-49af-bb61-4f969e240750 to f4505c13-797e-4d0b-b2ff-5fbce3438369. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Creating volume glance metadata for volume f4505c13-797e-4d0b-b2ff-5fbce3438369 backed by image 0f972b89-5809-49af-bb61-4f969e240750 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39814b3-dc20-493c-bd92-1c1e89f44d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4505c13-797e-4d0b-b2ff-5fbce3438369', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff57bd-e079-450f-81ad-7917a082e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:42 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Volume volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 (f4505c13-797e-4d0b-b2ff-5fbce3438369): created successfully Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff57bd-e079-450f-81ad-7917a082e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Flow 'volume_create_manager' (14eccb9b-1262-406b-9264-45b6367fd453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4953a218-8afe-4092-9c52-40febd742373 tempest-VolumesExtendTest-1116909557 None] Created volume successfully. Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5825a91-7963-43a0-934c-669f9f00fdff]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:43 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 Nov 05 08:34:43 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:43 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 2G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 2G" returned: 0 in 0.168s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.613s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-53d3047a-1280-4594-89d3-c72966068912 tempest-VolumesExtendTest-1116909557 None] Extend volume completed successfully. Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-f4505c13-797e-4d0b-b2ff-5fbce3438369-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-f4505c13-797e-4d0b-b2ff-5fbce3438369-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-quobyte-f4505c13-797e-4d0b-b2ff-5fbce3438369" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-f4505c13-797e-4d0b-b2ff-5fbce3438369" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f1350-eb39-4da7-9263-9189d380d92c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:45 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 Nov 05 08:34:45 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:45 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369" returned: 0 in 0.445s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:45 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369 Nov 05 08:34:45 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:46 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f4505c13-797e-4d0b-b2ff-5fbce3438369" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-f4505c13-797e-4d0b-b2ff-5fbce3438369" released by "delete_volume" :: held 0.759s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Created reservations ['3a7da778-c7a7-4b08-bb67-34e094205788', 'dd76231b-11ed-4d63-9110-8e3eb9707c49', 'cdde746b-a891-414a-9414-5d888f73a526', '929d0b78-f38f-4254-91af-d88005d68df7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:46 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:46 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:46 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Deleted volume successfully. Nov 05 08:34:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf6fefc8-de0d-4e3f-852c-583daf36dfa9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-f4505c13-797e-4d0b-b2ff-5fbce3438369-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Flow 'volume_create_manager' (c4d4ab1b-7fec-4a07-8788-6a3be9c03e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d75ab-20f9-4dd3-ae5d-dfce9b917340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d75ab-20f9-4dd3-ae5d-dfce9b917340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1536548612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0148dafe-0fd0-4747-8434-eb6942e0d6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68494d2a55b24f559a08d26a0df8867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:47Z,use_quota=True,user_id='259fa5f17c1b442abb6b5d588a9b9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58668dfc-fa73-4f7f-9ddd-9dd27ab3932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58668dfc-fa73-4f7f-9ddd-9dd27ab3932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99e29df-096d-4eba-add2-16fbc20dcee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99e29df-096d-4eba-add2-16fbc20dcee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0148dafe-0fd0-4747-8434-eb6942e0d6b4', 'volume_name': 'volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc419c4-086a-48a0-b996-5af47be800f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc419c4-086a-48a0-b996-5af47be800f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08282cc-bf25-4f92-955b-0bf752565820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Volume 0148dafe-0fd0-4747-8434-eb6942e0d6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4', 'volume_size': 1} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1536548612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0148dafe-0fd0-4747-8434-eb6942e0d6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68494d2a55b24f559a08d26a0df8867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:47Z,use_quota=True,user_id='259fa5f17c1b442abb6b5d588a9b9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Creating volume 0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:47 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:47 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 1073741824 Nov 05 08:34:47 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Flow 'volume_create_manager' (37ac4aeb-2c32-43df-918c-0a192c2e3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c8f026-1d0f-4991-a41d-b2a06ab73080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c8f026-1d0f-4991-a41d-b2a06ab73080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2082467763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816938f-cb6d-4721-8b98-533612c9a454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada25433d1644663a1df6a432fff1a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:47Z,use_quota=True,user_id='9d7afeba7008438089b80ce18c30e982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50eb9c22-568a-424e-94b0-dc620eafa689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50eb9c22-568a-424e-94b0-dc620eafa689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d72e8d-c228-4931-bf17-13d169ebdb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d72e8d-c228-4931-bf17-13d169ebdb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f816938f-cb6d-4721-8b98-533612c9a454', 'volume_name': 'volume-f816938f-cb6d-4721-8b98-533612c9a454', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97814d6-cf28-4905-b105-4db22d76a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97814d6-cf28-4905-b105-4db22d76a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d362c6-569e-48a6-9255-c3aa42aa907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Volume f816938f-cb6d-4721-8b98-533612c9a454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f816938f-cb6d-4721-8b98-533612c9a454', 'volume_size': 1} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 1073741824" returned: 0 in 0.416s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:47 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:47 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:47 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2082467763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816938f-cb6d-4721-8b98-533612c9a454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada25433d1644663a1df6a432fff1a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:47Z,use_quota=True,user_id='9d7afeba7008438089b80ce18c30e982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Creating volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:47 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:34:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08282cc-bf25-4f92-955b-0bf752565820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:48 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 1073741824 Nov 05 08:34:48 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1dc0e1-0ff6-41ba-978e-d6644228ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Volume volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 (0148dafe-0fd0-4747-8434-eb6942e0d6b4): created successfully Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1dc0e1-0ff6-41ba-978e-d6644228ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Flow 'volume_create_manager' (c4d4ab1b-7fec-4a07-8788-6a3be9c03e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-14963127-cd55-46d8-ab30-901916271233 tempest-VolumesExtendTest-1116909557 None] Created volume successfully. Nov 05 08:34:48 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 1073741824" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 Nov 05 08:34:48 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:48 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d362c6-569e-48a6-9255-c3aa42aa907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f816938f-cb6d-4721-8b98-533612c9a454', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca7206e-f185-446a-8e53-4a0ab608ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Volume volume-f816938f-cb6d-4721-8b98-533612c9a454 (f816938f-cb6d-4721-8b98-533612c9a454): created successfully Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca7206e-f185-446a-8e53-4a0ab608ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Flow 'volume_create_manager' (37ac4aeb-2c32-43df-918c-0a192c2e3aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cb3f47bf-c87d-4a53-b33c-3d5bf6f7d57c tempest-VolumesSnapshotListTestJSON-1396168321 None] Created volume successfully. Nov 05 08:34:48 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:34:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Creating offline snapshot d86fed4c-255a-4dd9-a558-8903b13061e4 of volume 0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee86ec7-21b7-4b20-bdb1-28c1091ac8e0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:49 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:49 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.374s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 1G Nov 05 08:34:49 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 1G" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 Nov 05 08:34:50 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4" returned: 0 in 0.291s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 is being set with open permissions: ugo+rw Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 Nov 05 08:34:50 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info Nov 05 08:34:50 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info is being set with open permissions: ugo+rw Nov 05 08:34:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info Nov 05 08:34:50 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:51 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.info" returned: 0 in 0.227s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.618s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Creating offline snapshot 4f394925-ba99-4076-86e4-6dcce0da5b88 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:34:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-37b0d42d-f50f-431d-969c-73490c203d9c tempest-VolumesExtendTest-1116909557 None] Create snapshot completed successfully Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd4739-9c5f-4c53-a9d8-5899a14cd525]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:51 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 Nov 05 08:34:51 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:51 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:51 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 1G Nov 05 08:34:51 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:52 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 1G" returned: 0 in 0.396s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:52 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:34:52 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:52 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:52 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 is being set with open permissions: ugo+rw Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:52 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:34:52 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:52 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.234s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:52 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info Nov 05 08:34:52 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:52 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:52 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info is being set with open permissions: ugo+rw Nov 05 08:34:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:53 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info Nov 05 08:34:53 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:53 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.info" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.698s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534afc4-47e8-4972-8185-067705b1be7d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a0c17097-7a65-4268-8a11-6da3da69a726 tempest-VolumesSnapshotListTestJSON-1396168321 None] Create snapshot completed successfully Nov 05 08:34:53 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:53 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:53 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.413s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 2G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 2G" returned: 0 in 0.229s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.704s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Creating offline snapshot 1150e6a5-6d59-44a8-9c28-160859999327 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69b5f1-73cc-471e-adbe-933a5c46d265]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-34e5519a-f3eb-4f18-b63c-4dde69f12c75 tempest-VolumesExtendTest-1116909557 None] Extend volume completed successfully. Nov 05 08:34:54 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:34:54 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:54 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:54 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 1G Nov 05 08:34:54 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:54 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 1G" returned: 0 in 0.439s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:54 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:34:54 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-d86fed4c-255a-4dd9-a558-8903b13061e4-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-d86fed4c-255a-4dd9-a558-8903b13061e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-quobyte-d86fed4c-255a-4dd9-a558-8903b13061e4" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-d86fed4c-255a-4dd9-a558-8903b13061e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Deleting offline snapshot d86fed4c-255a-4dd9-a558-8903b13061e4 of volume 0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] snapshot_file for this snap is: volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67e95d7-daf3-4812-982b-78c77c67a2d6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:55 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:55 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 is being set with open permissions: ugo+rw Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:55 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:34:55 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:55 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 Nov 05 08:34:55 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:55 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.247s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.509s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4bdc39dd-e8a3-451e-81a7-3befd4a44eb5 tempest-VolumesSnapshotListTestJSON-1396168321 None] Create snapshot completed successfully Nov 05 08:34:55 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4" returned: 0 in 0.444s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c483ac70-327a-4b3e-8ad5-cc83c9a91218]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:55 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:55 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:55 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.352s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:55 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 Nov 05 08:34:55 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Creating offline snapshot c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b5d6f-b8c9-4633-95d4-039658e6d23b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:56 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4" returned: 0 in 0.406s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:56 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4 Nov 05 08:34:56 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:56 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:34:56 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:56 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4.d86fed4c-255a-4dd9-a558-8903b13061e4" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-d86fed4c-255a-4dd9-a558-8903b13061e4" released by "_delete_snapshot" :: held 1.564s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" released by "delete_snapshot" :: held 1.589s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Created reservations ['657b036a-38b2-4cd4-aa47-dc6ff856a92b', '06f067ae-ae2c-4bc9-a161-ff4e55c96108', '64bfa0c7-588a-435b-90ee-b9fc90f87904', '3869a128-31f1-44ef-9218-c2d354ef19f5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:56 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:56 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 1G Nov 05 08:34:56 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Delete snapshot completed successfully. Nov 05 08:34:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ac713aac-ea92-43ca-a637-76bab499f9a3 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-d86fed4c-255a-4dd9-a558-8903b13061e4-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:57 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 1G" returned: 0 in 0.465s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:57 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 Nov 05 08:34:57 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-0148dafe-0fd0-4747-8434-eb6942e0d6b4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-0148dafe-0fd0-4747-8434-eb6942e0d6b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[06649b5d-d0bd-4b04-b9e8-ce7908a81b87]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:57 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:57 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:57 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" returned: 0 in 0.301s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:57 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 is being set with open permissions: ugo+rw Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:57 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 Nov 05 08:34:57 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:57 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:57 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:57 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4 Nov 05 08:34:57 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.507s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6a2459b5-4df4-4504-b21f-642d8749df01 tempest-VolumesSnapshotListTestJSON-1396168321 None] Create snapshot completed successfully Nov 05 08:34:57 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0148dafe-0fd0-4747-8434-eb6942e0d6b4" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-quobyte-0148dafe-0fd0-4747-8434-eb6942e0d6b4" released by "delete_volume" :: held 0.691s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Created reservations ['39548858-7f77-4d73-9bb2-9803e119509f', '4cff2908-d689-4ea7-bcd8-76279704573d', 'beb0d0de-28de-40ca-94ee-9e1976b77762', '68f304fa-441d-41d0-9679-159dbc11f061'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:58 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:34:58 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:58 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Deleted volume successfully. Nov 05 08:34:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b386fe5-5817-4310-b3cf-3877a16267c9 tempest-VolumesExtendTest-1116909557 None] Lock "cinder-0148dafe-0fd0-4747-8434-eb6942e0d6b4-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Deleting offline snapshot c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] snapshot_file for this snap is: volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7968feb-a37e-48cb-9ee9-444a4ac8b175]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:59 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 Nov 05 08:34:59 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:59 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" returned: 0 in 0.429s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b78bd-1887-4dab-b37e-40a7d3b004ac]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:00 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:35:00 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:00 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.485s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:00 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 Nov 05 08:35:00 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dcaae84c-ba8d-4c24-9e71-aa55c9be710f req-3d2e7910-2733-488a-8267-87f0b2611517 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dcaae84c-ba8d-4c24-9e71-aa55c9be710f req-3d2e7910-2733-488a-8267-87f0b2611517 tempest-TestStampPattern-1233313966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-dcaae84c-ba8d-4c24-9e71-aa55c9be710f req-3d2e7910-2733-488a-8267-87f0b2611517 tempest-TestStampPattern-1233313966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-dcaae84c-ba8d-4c24-9e71-aa55c9be710f req-3d2e7910-2733-488a-8267-87f0b2611517 tempest-TestStampPattern-1233313966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-2eeb2124-a381-4ac7-be30-571667dafc48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4173a56-6aec-4c53-97c7-81a2100d292f', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:35:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-dcaae84c-ba8d-4c24-9e71-aa55c9be710f req-3d2e7910-2733-488a-8267-87f0b2611517 tempest-TestStampPattern-1233313966 None] attachment_update completed successfully. Nov 05 08:35:00 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" returned: 0 in 0.526s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:00 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4 Nov 05 08:35:00 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:01 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" returned: 0 in 0.279s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4" released by "_delete_snapshot" :: held 1.902s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" released by "delete_snapshot" :: held 1.931s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:01 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Created reservations ['0a7b192a-136b-4cbd-a564-8a692b016169', '115a25a0-c0d1-4ab8-82df-50a75e3652a2', 'ab8f633a-e0c5-4db5-8255-219ec0338583', '89a4116b-5e58-4a89-9f92-e9c464e9bae3'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Delete snapshot completed successfully. Nov 05 08:35:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cac28dad-e5c2-4039-b80a-423755ae467e tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-c0b056ae-e4e8-4521-a0cc-5db3b2d875a4-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-1150e6a5-6d59-44a8-9c28-160859999327-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-1150e6a5-6d59-44a8-9c28-160859999327-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-1150e6a5-6d59-44a8-9c28-160859999327" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-1150e6a5-6d59-44a8-9c28-160859999327" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Deleting offline snapshot 1150e6a5-6d59-44a8-9c28-160859999327 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] snapshot_file for this snap is: volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef40f2-48ff-44bb-be7d-7368c53df306]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=103,cinder:UPDATE=114,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Flow 'volume_create_manager' (7842834e-c486-4603-a6d3-4a9765c16730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e15f09-8cd4-4b8b-a92f-1106b6cc8138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=118,cinder:INSERT=34,cinder:DELETE=11,cinder:SELECT=96 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:02 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:35:02 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e15f09-8cd4-4b8b-a92f-1106b6cc8138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-21088559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da97c8a-5d61-4502-b29a-1a82c7b0cfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f40f98caa9842228d4a96563d7d3ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:03Z,use_quota=True,user_id='50b006932af74b29aa2072ff5b7c72f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994d10ef-9198-4f17-b751-c19ccaf39c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994d10ef-9198-4f17-b751-c19ccaf39c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905dbe0d-bcc1-4b5b-abe3-d511255234fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905dbe0d-bcc1-4b5b-abe3-d511255234fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da97c8a-5d61-4502-b29a-1a82c7b0cfdb', 'volume_name': 'volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb', 'volume_size': 2}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02a9f81-94bb-4189-a108-09b6f6cf66fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02a9f81-94bb-4189-a108-09b6f6cf66fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e27a12-a430-44e1-acf8-d0ff0c95c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:02 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Volume 9da97c8a-5d61-4502-b29a-1a82c7b0cfdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb', 'volume_size': 2} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-21088559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da97c8a-5d61-4502-b29a-1a82c7b0cfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f40f98caa9842228d4a96563d7d3ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:03Z,use_quota=True,user_id='50b006932af74b29aa2072ff5b7c72f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Creating volume 9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:02 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:35:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb 2147483648 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb 2147483648 Nov 05 08:35:02 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.425s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[067e2476-c4c2-4db3-acbd-1b786752bc99]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:35:03 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb 2147483648" returned: 0 in 0.556s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb Nov 05 08:35:03 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:35:03 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" returned: 0 in 0.287s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e27a12-a430-44e1-acf8-d0ff0c95c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb', 'volume_size': 2}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5601a75-4e5a-4ab4-9601-b3a2abe9120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:03 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Volume volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb (9da97c8a-5d61-4502-b29a-1a82c7b0cfdb): created successfully Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5601a75-4e5a-4ab4-9601-b3a2abe9120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:03 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Flow 'volume_create_manager' (7842834e-c486-4603-a6d3-4a9765c16730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e616c9ca-7839-48cd-b152-47d090a1125e tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Created volume successfully. Nov 05 08:35:04 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.453s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:04 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327 Nov 05 08:35:04 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:04 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.1150e6a5-6d59-44a8-9c28-160859999327" returned: 0 in 0.262s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-1150e6a5-6d59-44a8-9c28-160859999327" released by "_delete_snapshot" :: held 1.681s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" released by "delete_snapshot" :: held 1.709s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Created reservations ['79d52b1e-b1b5-4e3b-8ba9-22452b85bcf4', 'cb46e00c-09f9-4e4f-9829-a2ba293d08be', 'ef042ba7-5b0a-460c-9385-b70eef7b4366', '0d6a131b-76b1-43cd-ae43-45c8eb4882e8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Delete snapshot completed successfully. Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-89b35f54-e3f2-4d74-b2b7-1eb9223700cb tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-1150e6a5-6d59-44a8-9c28-160859999327-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-4f394925-ba99-4076-86e4-6dcce0da5b88-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-4f394925-ba99-4076-86e4-6dcce0da5b88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-4f394925-ba99-4076-86e4-6dcce0da5b88" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-4f394925-ba99-4076-86e4-6dcce0da5b88" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Deleting offline snapshot 4f394925-ba99-4076-86e4-6dcce0da5b88 of volume f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] snapshot_file for this snap is: volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe81d0-4e50-4456-b891-5dd96415e8f7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:04 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:35:05 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Creating offline snapshot 89d0e5ae-6a60-4704-812b-8c6c802b2165 of volume 9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c1dc5f-43bc-47ba-a916-ee6a8c6ba029]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:05 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb Nov 05 08:35:05 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:05 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.456s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816938f-cb6d-4721-8b98-533612c9a454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d36fd1e-bd38-4ab1-914e-054a50e7c28e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:05 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 Nov 05 08:35:05 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:05 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 2G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:05 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 2G Nov 05 08:35:05 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:05 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454" returned: 0 in 0.441s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:05 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:35:05 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-7f49f331-8fb7-4dfc-b3da-e55b991b2fb5 req-a55db48d-71b2-4067-b663-f64c3275a571 tempest-TestStampPattern-1233313966 None] Terminate volume connection completed successfully. Nov 05 08:35:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-7f49f331-8fb7-4dfc-b3da-e55b991b2fb5 req-a55db48d-71b2-4067-b663-f64c3275a571 tempest-TestStampPattern-1233313966 None] Deleting attachment f4173a56-6aec-4c53-97c7-81a2100d292f. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:35:06 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 2G" returned: 0 in 0.532s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:06 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 Nov 05 08:35:06 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.428s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:06 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88 Nov 05 08:35:06 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 is being set with open permissions: ugo+rw Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:06 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 Nov 05 08:35:06 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454.4f394925-ba99-4076-86e4-6dcce0da5b88" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-4f394925-ba99-4076-86e4-6dcce0da5b88" released by "_delete_snapshot" :: held 1.712s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" released by "delete_snapshot" :: held 1.740s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Created reservations ['6a3ba62e-e9f6-4493-8d96-fce04120f449', '8213d3a6-6394-4a75-be95-1bce34935008', '99923eac-b402-4e48-b749-1904496cc409', '14231fa0-6672-4743-9de3-7880c85e99f9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Delete snapshot completed successfully. Nov 05 08:35:06 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bb0ee41-80d7-44fc-802d-579c8c6e3c5f tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-4f394925-ba99-4076-86e4-6dcce0da5b88-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:06 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info Nov 05 08:35:06 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:07 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-f816938f-cb6d-4721-8b98-533612c9a454-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info" returned: 0 in 0.293s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info is being set with open permissions: ugo+rw Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-f816938f-cb6d-4721-8b98-533612c9a454-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:07 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info Nov 05 08:35:07 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f60835-4779-4852-8af5-a5f05a01fab4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 Nov 05 08:35:07 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.info" returned: 0 in 0.267s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.389s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Creating offline snapshot c9d157cb-1983-4f51-90d4-48d4a1772e0b of volume 2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4a2be328-d1a6-4471-b6e2-fff2cf40c384 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Create snapshot completed successfully Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa25dd1-8e7e-4f9d-9542-03aa31102f81]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:35:07 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454 Nov 05 08:35:07 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b 1G Nov 05 08:35:07 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f816938f-cb6d-4721-8b98-533612c9a454" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-quobyte-f816938f-cb6d-4721-8b98-533612c9a454" released by "delete_volume" :: held 0.699s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Created reservations ['f74f82ad-731b-43ad-8356-a66260d7d2d8', 'd1dc012e-dc37-4f13-8e4a-9bde0be92389', '176c1430-881f-4cb7-b161-b28dec446942', '4f76138f-eb0f-4717-9f66-ac840d123ee7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:35:07 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:08 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b 1G" returned: 0 in 0.437s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb2124-a381-4ac7-be30-571667dafc48 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:08 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.285s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Deleted volume successfully. Nov 05 08:35:08 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb2124-a381-4ac7-be30-571667dafc48 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:35:08 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1f56428c-2b3c-4b0a-ba74-67e8fdad5137 tempest-VolumesSnapshotListTestJSON-1396168321 None] Lock "cinder-f816938f-cb6d-4721-8b98-533612c9a454-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "cinder-89d0e5ae-6a60-4704-812b-8c6c802b2165-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-89d0e5ae-6a60-4704-812b-8c6c802b2165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "cinder-quobyte-89d0e5ae-6a60-4704-812b-8c6c802b2165" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-89d0e5ae-6a60-4704-812b-8c6c802b2165" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Deleting offline snapshot 89d0e5ae-6a60-4704-812b-8c6c802b2165 of volume 9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] snapshot_file for this snap is: volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c622d10-c1a7-48ef-9c60-45c02989ee39]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:08 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb2124-a381-4ac7-be30-571667dafc48 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:08 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b is being set with open permissions: ugo+rw Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:08 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:35:08 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:08 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 Nov 05 08:35:08 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:08 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.281s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:08 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info Nov 05 08:35:08 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:08 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bbc8a2-2b0c-43c6-9667-299eb824c505]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:09 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb Nov 05 08:35:09 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:09 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info" returned: 0 in 0.296s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:09 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info is being set with open permissions: ugo+rw Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:09 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info Nov 05 08:35:09 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:09 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:09 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 Nov 05 08:35:09 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:09 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.info" returned: 0 in 0.293s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-05aeac0e-c298-450d-a91a-dfec79a152be tempest-TestStampPattern-1233313966 None] Create snapshot completed successfully Nov 05 08:35:09 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:09 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165 Nov 05 08:35:09 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:10 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb.89d0e5ae-6a60-4704-812b-8c6c802b2165" returned: 0 in 0.282s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-89d0e5ae-6a60-4704-812b-8c6c802b2165" released by "_delete_snapshot" :: held 1.643s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" released by "delete_snapshot" :: held 1.677s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Created reservations ['a8ba8980-6df6-4aaa-b23a-43ba3c399e83', '091c60cd-25ef-478d-b7b6-73379b7435d3', '2bd66ac1-7198-48cf-83c9-8327c4807564', '57507b5e-8efc-4725-9831-357760a63992'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Delete snapshot completed successfully. Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1c90ef49-3171-42f8-aea1-3ea699f3d56f tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-89d0e5ae-6a60-4704-812b-8c6c802b2165-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "cinder-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfa752-8e02-4126-b2fb-f46aa3280f19]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:10 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb Nov 05 08:35:10 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:11 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:11 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb Nov 05 08:35:11 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:11 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" returned: 0 in 0.328s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-quobyte-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb" released by "delete_volume" :: held 0.841s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Created reservations ['743a412c-7f09-4af4-892d-5e407b19e454', '29203547-7b53-49e0-b774-e86e2a271de5', '7fa06621-92d1-4282-b938-790aad14035b', '8f7032f9-775a-488e-9963-fc06a6c343c9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:11 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:35:11 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:12 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:12 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Deleted volume successfully. Nov 05 08:35:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-1ae45149-bc8e-4ce3-b248-63bf9d168770 tempest-VolumesSnapshotNegativeTestJSON-237727199 None] Lock "cinder-9da97c8a-5d61-4502-b29a-1a82c7b0cfdb-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Flow 'volume_create_manager' (36bdcd6f-dddf-4d85-a546-859e497a0a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6ccab-9039-4840-9f03-7d5ca7b33c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6ccab-9039-4840-9f03-7d5ca7b33c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-318103562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37492383b2f34f2393ca7ce7e89ba812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9d157cb-1983-4f51-90d4-48d4a1772e0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:18Z,use_quota=True,user_id='278949903ace4371853e8dbdcae012ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e08aa6-f8c3-4a4e-b054-f83431759895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e08aa6-f8c3-4a4e-b054-f83431759895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc8a84b-518f-48b4-a460-cba3cd8595cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc8a84b-518f-48b4-a460-cba3cd8595cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e', 'volume_name': 'volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e', 'volume_size': 1, 'snapshot_id': 'c9d157cb-1983-4f51-90d4-48d4a1772e0b'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d17926-246e-41e0-a44a-471aaf0eb44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d17926-246e-41e0-a44a-471aaf0eb44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97986d9-66a2-4ef7-9491-9c31fd2f8e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Volume 86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e', 'volume_size': 1, 'snapshot_id': 'c9d157cb-1983-4f51-90d4-48d4a1772e0b'} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Creating volume 86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e from snapshot c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] snapshot: c9d157cb-1983-4f51-90d4-48d4a1772e0b, volume: 86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b52b87b-72d2-425c-913e-9c0816ee5491]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:18 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:35:18 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:18 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.458s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeb2124-a381-4ac7-be30-571667dafc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84803d8-2b21-4fd9-8430-8eeb69cb6ab7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:35:19 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:19 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:35:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:35:19 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:35:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e Nov 05 08:35:19 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=38,cinder:SELECT=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:28 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" returned: 0 in 9.103s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48, size 1024.00 MB, duration 9.10 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:35:28 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Converted 1024.00 MB image at 112.48 MB/s Nov 05 08:35:28 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e is being set with open permissions: ugo+rw Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:28 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e Nov 05 08:35:28 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:28 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" released by "_copy_volume_from_snapshot" :: held 10.555s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" released by "_create_volume_from_snapshot" :: held 10.655s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.674s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97986d9-66a2-4ef7-9491-9c31fd2f8e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e', 'volume_size': 1, 'snapshot_id': 'c9d157cb-1983-4f51-90d4-48d4a1772e0b'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc64a838-72fe-4275-a23c-d21838b95d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:29 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Volume volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e (86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e): created successfully Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc64a838-72fe-4275-a23c-d21838b95d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Flow 'volume_create_manager' (36bdcd6f-dddf-4d85-a546-859e497a0a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-af890b36-a936-4e5a-b560-20d63b1c416e tempest-TestStampPattern-1233313966 None] Created volume successfully. Nov 05 08:35:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:39 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:48 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:35:48 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:49 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:35:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:35:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (928b08b7-5d7b-4776-b4ad-5cee2a6c68fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fc7ab1-24cb-45ce-9524-bf4129d6bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fc7ab1-24cb-45ce-9524-bf4129d6bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983358537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ede6bf3-1364-457b-bc14-a015770ef4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:56Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5447469-2858-4a6d-87fe-cbe535678e6c),volume_type_id=e5447469-2858-4a6d-87fe-cbe535678e6c)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8ea7ea-dab3-4206-9d05-05379fea1388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8ea7ea-dab3-4206-9d05-05379fea1388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855d724a-5af8-448a-aeab-8ba0877a476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855d724a-5af8-448a-aeab-8ba0877a476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ede6bf3-1364-457b-bc14-a015770ef4fa', 'volume_name': 'volume-7ede6bf3-1364-457b-bc14-a015770ef4fa', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef2137-80bf-4293-be99-de208e049414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef2137-80bf-4293-be99-de208e049414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bfe8a2-75ad-4c7d-8d12-3bd03ea8a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume 7ede6bf3-1364-457b-bc14-a015770ef4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ede6bf3-1364-457b-bc14-a015770ef4fa', 'volume_size': 1} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983358537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ede6bf3-1364-457b-bc14-a015770ef4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:56Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5447469-2858-4a6d-87fe-cbe535678e6c),volume_type_id=e5447469-2858-4a6d-87fe-cbe535678e6c)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Creating volume 7ede6bf3-1364-457b-bc14-a015770ef4fa {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:56 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:35:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:56 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa 1073741824 Nov 05 08:35:56 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:56 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa 1073741824" returned: 0 in 0.730s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (aea6d907-8c8c-46a5-9c4d-98912733e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454708a-ee7e-44cc-b075-9859825fcbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454708a-ee7e-44cc-b075-9859825fcbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1309623649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67dca1d-f577-4cde-806a-8ee701acdae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:57Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2d1278a-2e7f-4aea-984b-a6aad6afe5bf),volume_type_id=c2d1278a-2e7f-4aea-984b-a6aad6afe5bf)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9be64-3dac-4010-a2b7-415e2c745ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9be64-3dac-4010-a2b7-415e2c745ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5955fc6-6f9c-4b43-966b-53ea7478b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5955fc6-6f9c-4b43-966b-53ea7478b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67dca1d-f577-4cde-806a-8ee701acdae6', 'volume_name': 'volume-c67dca1d-f577-4cde-806a-8ee701acdae6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15877ff-b0aa-4dfb-b603-22387f6c41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15877ff-b0aa-4dfb-b603-22387f6c41ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca64801-16c6-4c0b-a8a3-befd2325deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume c67dca1d-f577-4cde-806a-8ee701acdae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67dca1d-f577-4cde-806a-8ee701acdae6', 'volume_size': 1} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:57 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa Nov 05 08:35:57 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:57 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa" returned: 0 in 0.360s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1309623649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67dca1d-f577-4cde-806a-8ee701acdae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:57Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2d1278a-2e7f-4aea-984b-a6aad6afe5bf),volume_type_id=c2d1278a-2e7f-4aea-984b-a6aad6afe5bf)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Creating volume c67dca1d-f577-4cde-806a-8ee701acdae6 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:57 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:57 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 1073741824 Nov 05 08:35:57 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bfe8a2-75ad-4c7d-8d12-3bd03ea8a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ede6bf3-1364-457b-bc14-a015770ef4fa', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbbf5c9-7ca5-4f06-99f2-7e4542452fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume volume-7ede6bf3-1364-457b-bc14-a015770ef4fa (7ede6bf3-1364-457b-bc14-a015770ef4fa): created successfully Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbbf5c9-7ca5-4f06-99f2-7e4542452fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (928b08b7-5d7b-4776-b4ad-5cee2a6c68fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-81378f96-c465-4219-a1aa-07fa26132155 tempest-TestInstancesWithCinderVolumes-415489405 None] Created volume successfully. Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (32796067-6e72-4f9f-9e0b-ac47b3ec8ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad668d0-e03d-4375-94cd-49a6d8d08883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad668d0-e03d-4375-94cd-49a6d8d08883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1683811449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32df91a-d998-4e2d-a679-d0138fd795a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:58Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65293fbb-994b-4fbf-b43b-362d53b06c8b),volume_type_id=65293fbb-994b-4fbf-b43b-362d53b06c8b)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3572838-38ce-4a1f-b29c-d46555764231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3572838-38ce-4a1f-b29c-d46555764231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134c332-6201-4243-809b-c609ed12417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:35:58 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134c332-6201-4243-809b-c609ed12417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a32df91a-d998-4e2d-a679-d0138fd795a7', 'volume_name': 'volume-a32df91a-d998-4e2d-a679-d0138fd795a7', 'volume_size': 1, 'image_id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145041399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a17293bc423f41c99be77f4b90a2c294', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'created_at': datetime.datetime(2026, 11, 5, 7, 35, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bed650a0-a1ed-4000-a3aa-ea57199cb350/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5a3663-1545-4873-80ee-a6b2042ba75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5a3663-1545-4873-80ee-a6b2042ba75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1e046c-d4cf-45d3-82ed-f98b5eecf058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Volume a32df91a-d998-4e2d-a679-d0138fd795a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a32df91a-d998-4e2d-a679-d0138fd795a7', 'volume_size': 1, 'image_id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145041399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a17293bc423f41c99be77f4b90a2c294', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'created_at': datetime.datetime(2026, 11, 5, 7, 35, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bed650a0-a1ed-4000-a3aa-ea57199cb350/file', 'properties': {}}, 'image_service': } Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Trying to clone a32df91a-d998-4e2d-a679-d0138fd795a7 from image bed650a0-a1ed-4000-a3aa-ea57199cb350 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 1073741824" returned: 0 in 0.768s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Flow 'volume_create_manager' (1a84fbce-d95e-4952-8022-0abb727aebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1683c1ec-5435-4d59-8009-28c6177cda40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1683c1ec-5435-4d59-8009-28c6177cda40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-917171858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe862099-b1cf-4dc8-8222-1e9daba90b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffd6f73be9749fc9f4262f3cc6f0312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:58Z,use_quota=True,user_id='d7404d096e644ed1a92cdd80b51a486c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac368e-8e58-4525-9dcc-b5cfee0d6be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac368e-8e58-4525-9dcc-b5cfee0d6be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74506c2-2f83-493f-adc6-d2c311dc4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74506c2-2f83-493f-adc6-d2c311dc4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe862099-b1cf-4dc8-8222-1e9daba90b35', 'volume_name': 'volume-fe862099-b1cf-4dc8-8222-1e9daba90b35', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27ebeec-79ed-45f4-856c-78cec12f2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27ebeec-79ed-45f4-856c-78cec12f2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65f0bb4-5256-4afe-9638-65fc00a97f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Volume fe862099-b1cf-4dc8-8222-1e9daba90b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe862099-b1cf-4dc8-8222-1e9daba90b35', 'volume_size': 1} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 Nov 05 08:35:58 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:58 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6" returned: 0 in 0.267s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-917171858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe862099-b1cf-4dc8-8222-1e9daba90b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffd6f73be9749fc9f4262f3cc6f0312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:58Z,use_quota=True,user_id='d7404d096e644ed1a92cdd80b51a486c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Creating volume fe862099-b1cf-4dc8-8222-1e9daba90b35 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:58 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca64801-16c6-4c0b-a8a3-befd2325deb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67dca1d-f577-4cde-806a-8ee701acdae6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff907ad-5a93-4780-8da9-8a5da8a8ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:58 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 1073741824 Nov 05 08:35:58 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Volume volume-c67dca1d-f577-4cde-806a-8ee701acdae6 (c67dca1d-f577-4cde-806a-8ee701acdae6): created successfully Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff907ad-5a93-4780-8da9-8a5da8a8ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (aea6d907-8c8c-46a5-9c4d-98912733e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a786e69b-a18b-4e4e-8342-79b3ad0d4918 tempest-TestInstancesWithCinderVolumes-415489405 None] Created volume successfully. Nov 05 08:35:59 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 1073741824" returned: 0 in 0.509s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:59 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 Nov 05 08:35:59 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:59 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65f0bb4-5256-4afe-9638-65fc00a97f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe862099-b1cf-4dc8-8222-1e9daba90b35', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee440470-92dd-425b-ac7b-64001cb3b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Volume volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 (fe862099-b1cf-4dc8-8222-1e9daba90b35): created successfully Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee440470-92dd-425b-ac7b-64001cb3b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Flow 'volume_create_manager' (1a84fbce-d95e-4952-8022-0abb727aebde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-09a6f84b-512c-44e6-9fdf-26e41a53d53d tempest-TestMinimumBasicScenario-1510931765 None] Created volume successfully. Nov 05 08:36:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-54a75599-0ed5-459b-a7e9-82fcd9f821bc req-39366185-892b-4d2f-827b-c6df2dd9e9e0 tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-54a75599-0ed5-459b-a7e9-82fcd9f821bc req-39366185-892b-4d2f-827b-c6df2dd9e9e0 tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-54a75599-0ed5-459b-a7e9-82fcd9f821bc req-39366185-892b-4d2f-827b-c6df2dd9e9e0 tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-54a75599-0ed5-459b-a7e9-82fcd9f821bc req-39366185-892b-4d2f-827b-c6df2dd9e9e0 tempest-TestMinimumBasicScenario-1510931765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-fe862099-b1cf-4dc8-8222-1e9daba90b35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45dc9874-85da-4c44-8b1a-a0cdcadaf8b0', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-54a75599-0ed5-459b-a7e9-82fcd9f821bc req-39366185-892b-4d2f-827b-c6df2dd9e9e0 tempest-TestMinimumBasicScenario-1510931765 None] attachment_update completed successfully. Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD, size 20.69 MB, duration 3.79 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:36:02 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Image download 20.69 MB at 5.45 MB/s Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a0fd78-d7bd-49b8-9863-c53fa3a915d4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:02 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD Nov 05 08:36:02 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:02 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Temporary image bed650a0-a1ed-4000-a3aa-ea57199cb350 is fetched for user 431126cfaddd4138bcae5dc5d627eed2. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adfd527-a0ab-4761-9dfc-249884c2e2d7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:02 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD Nov 05 08:36:02 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:03 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1683811449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32df91a-d998-4e2d-a679-d0138fd795a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17293bc423f41c99be77f4b90a2c294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:58Z,use_quota=True,user_id='431126cfaddd4138bcae5dc5d627eed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65293fbb-994b-4fbf-b43b-362d53b06c8b),volume_type_id=65293fbb-994b-4fbf-b43b-362d53b06c8b)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Creating volume a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:03 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:03 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1073741824 Nov 05 08:36:03 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:03 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1073741824" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:03 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 Nov 05 08:36:03 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:03 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Attempting download of bed650a0-a1ed-4000-a3aa-ea57199cb350 ((None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}])) to volume a32df91a-d998-4e2d-a679-d0138fd795a7. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[46148152-370b-45aa-9cf4-c09715bdc93b]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:04 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w Nov 05 08:36:04 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:04 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w" returned: 0 in 0.370s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:04 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w Nov 05 08:36:04 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:04 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w" returned: 1 in 0.356s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bed650a0-a1ed-4000-a3aa-ea57199cb350_3lc4ic1w' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8c6a9-1c25-43bf-ba12-decf3b91861a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:04 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD Nov 05 08:36:04 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:05 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:05 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] bed650a0-a1ed-4000-a3aa-ea57199cb350 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:36:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:05 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 Nov 05 08:36:05 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:07 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7" returned: 0 in 2.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bed650a0-a1ed-4000-a3aa-ea57199cb350_qn4obyxxdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:36:07 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Converted 112.00 MB image at 49.87 MB/s Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:07 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1G Nov 05 08:36:07 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:07 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 1G" returned: 0 in 0.433s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Downloaded image bed650a0-a1ed-4000-a3aa-ea57199cb350 ((None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}])) to volume a32df91a-d998-4e2d-a679-d0138fd795a7 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Temporary image bed650a0-a1ed-4000-a3aa-ea57199cb350 for user 431126cfaddd4138bcae5dc5d627eed2 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Marking volume a32df91a-d998-4e2d-a679-d0138fd795a7 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Copying metadata from image bed650a0-a1ed-4000-a3aa-ea57199cb350 to a32df91a-d998-4e2d-a679-d0138fd795a7. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Creating volume glance metadata for volume a32df91a-d998-4e2d-a679-d0138fd795a7 backed by image bed650a0-a1ed-4000-a3aa-ea57199cb350 with: {'image_id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'image_name': 'tempest-scenario-img--145041399', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1e046c-d4cf-45d3-82ed-f98b5eecf058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32df91a-d998-4e2d-a679-d0138fd795a7', 'volume_size': 1, 'image_id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bed650a0-a1ed-4000-a3aa-ea57199cb350', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145041399', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a17293bc423f41c99be77f4b90a2c294', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bed650a0-a1ed-4000-a3aa-ea57199cb350', 'created_at': datetime.datetime(2026, 11, 5, 7, 35, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bed650a0-a1ed-4000-a3aa-ea57199cb350/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d38e64-e0eb-43f5-b074-da11cdcbd66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:07 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Volume volume-a32df91a-d998-4e2d-a679-d0138fd795a7 (a32df91a-d998-4e2d-a679-d0138fd795a7): created successfully Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d38e64-e0eb-43f5-b074-da11cdcbd66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Flow 'volume_create_manager' (32796067-6e72-4f9f-9e0b-ac47b3ec8ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-61a3c77f-f42b-4b55-869b-5b0dd46fdcbc tempest-TestInstancesWithCinderVolumes-415489405 None] Created volume successfully. Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e1a72815-82b8-47e9-b5c1-a74b6f81612d req-0f1a4b60-fd6f-44b9-a1b9-fc992007df60 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e1a72815-82b8-47e9-b5c1-a74b6f81612d req-0f1a4b60-fd6f-44b9-a1b9-fc992007df60 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-e1a72815-82b8-47e9-b5c1-a74b6f81612d req-0f1a4b60-fd6f-44b9-a1b9-fc992007df60 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-e1a72815-82b8-47e9-b5c1-a74b6f81612d req-0f1a4b60-fd6f-44b9-a1b9-fc992007df60 tempest-TestInstancesWithCinderVolumes-415489405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-a32df91a-d998-4e2d-a679-d0138fd795a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9f24cac-22cc-4ff3-8ec2-fc5f1daca116', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-e1a72815-82b8-47e9-b5c1-a74b6f81612d req-0f1a4b60-fd6f-44b9-a1b9-fc992007df60 tempest-TestInstancesWithCinderVolumes-415489405 None] attachment_update completed successfully. Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-464a7781-5928-4172-8826-743ba09147a8 req-755ba7b9-5d33-405a-be1a-42fcfafb76a2 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-464a7781-5928-4172-8826-743ba09147a8 req-755ba7b9-5d33-405a-be1a-42fcfafb76a2 tempest-TestStampPattern-1233313966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-464a7781-5928-4172-8826-743ba09147a8 req-755ba7b9-5d33-405a-be1a-42fcfafb76a2 tempest-TestStampPattern-1233313966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:12 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-464a7781-5928-4172-8826-743ba09147a8 req-755ba7b9-5d33-405a-be1a-42fcfafb76a2 tempest-TestStampPattern-1233313966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ace7f603-9339-4520-a820-ed54b05cafef', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-464a7781-5928-4172-8826-743ba09147a8 req-755ba7b9-5d33-405a-be1a-42fcfafb76a2 tempest-TestStampPattern-1233313966 None] attachment_update completed successfully. Nov 05 08:36:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-593f1d3f-6e4f-49e3-af77-c11a869c67b1 req-e93fcdd6-7078-4716-b122-7856f9c4fcaf tempest-TestStampPattern-1233313966 None] Terminate volume connection completed successfully. Nov 05 08:36:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-593f1d3f-6e4f-49e3-af77-c11a869c67b1 req-e93fcdd6-7078-4716-b122-7856f9c4fcaf tempest-TestStampPattern-1233313966 None] Deleting attachment ace7f603-9339-4520-a820-ed54b05cafef. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "cinder-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87bb342-2481-4a35-b558-13185f281798]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:22 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e Nov 05 08:36:22 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" returned: 0 in 0.522s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e Nov 05 08:36:23 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" returned: 0 in 0.279s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e" released by "delete_volume" :: held 0.860s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Created reservations ['7ffa697d-871f-4d03-9fa8-ff412b04a681', 'cc8f467e-a529-46ab-b6f0-16678379994b', 'fb8ffedb-2409-4951-b280-c070e16b2472', '35cdccaa-f614-4828-a9f3-f645d84c1b4b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:36:23 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:24 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.366s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Deleted volume successfully. Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0a0bb859-36b9-4c4e-b824-13f6d487f449 tempest-TestStampPattern-1233313966 None] Lock "cinder-86c4cf08-7c62-4d45-b6fe-2ca02dcc3f2e-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-c9d157cb-1983-4f51-90d4-48d4a1772e0b-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-c9d157cb-1983-4f51-90d4-48d4a1772e0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Deleting offline snapshot c9d157cb-1983-4f51-90d4-48d4a1772e0b of volume 2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] snapshot_file for this snap is: volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecf92a3-57de-4248-b11b-239a301e97af]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:36:24 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:24 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.423s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeb2124-a381-4ac7-be30-571667dafc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999806b-a2fd-4906-a10b-24693d28f415]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:36:24 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:25 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.674s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:25 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:36:25 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:25 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.589s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:26 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b Nov 05 08:36:26 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:26 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48.c9d157cb-1983-4f51-90d4-48d4a1772e0b" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-c9d157cb-1983-4f51-90d4-48d4a1772e0b" released by "_delete_snapshot" :: held 2.128s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" released by "delete_snapshot" :: held 2.161s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Created reservations ['b721701e-3e3c-4942-8696-cb3282ee60e5', 'cb991af5-bbc5-40f4-92bc-3f0e0bf6f389', 'be7708fb-3b03-4ed9-a8c8-a586134f2ec5', '88609164-f96e-4353-9a38-6cb5ad926f25'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Delete snapshot completed successfully. Nov 05 08:36:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d94f580d-c098-4d81-9047-067794f56a68 tempest-TestStampPattern-1233313966 None] Lock "cinder-c9d157cb-1983-4f51-90d4-48d4a1772e0b-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-2eeb2124-a381-4ac7-be30-571667dafc48-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "cinder-2eeb2124-a381-4ac7-be30-571667dafc48-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Acquiring lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b1d20-8bb4-46b6-8de2-63334fdf3593]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:32 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:36:32 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:32 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.406s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:32 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48 Nov 05 08:36:32 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:32 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2eeb2124-a381-4ac7-be30-571667dafc48" returned: 0 in 0.282s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "cinder-quobyte-2eeb2124-a381-4ac7-be30-571667dafc48" released by "delete_volume" :: held 0.801s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:32 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Created reservations ['582feb37-e69b-4831-96f1-0320952fe27b', '08d3b17f-907b-484c-9147-fa5ca8814727', 'da18524b-a6dd-4325-a8fd-8e0fbf33b787', '37334ac6-f0df-4f40-9613-de124e74bdb9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:33 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:36:33 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:33 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.375s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Deleted volume successfully. Nov 05 08:36:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca90fd53-5b43-47ce-8eee-9e9404e8a4b5 tempest-TestStampPattern-1233313966 None] Lock "cinder-2eeb2124-a381-4ac7-be30-571667dafc48-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:43 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=50,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:36:43 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=39,cinder:SELECT=50,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:36:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-6fab85fc-58ea-4c30-8768-c66c00b57487 req-28a915cb-d5af-4a6e-a2bd-c35afcb17bef tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-6fab85fc-58ea-4c30-8768-c66c00b57487 req-28a915cb-d5af-4a6e-a2bd-c35afcb17bef tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-6fab85fc-58ea-4c30-8768-c66c00b57487 req-28a915cb-d5af-4a6e-a2bd-c35afcb17bef tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-6fab85fc-58ea-4c30-8768-c66c00b57487 req-28a915cb-d5af-4a6e-a2bd-c35afcb17bef tempest-TestInstancesWithCinderVolumes-415489405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-7ede6bf3-1364-457b-bc14-a015770ef4fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d17afaf-200b-4c08-b78a-40380d9427b6', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-6fab85fc-58ea-4c30-8768-c66c00b57487 req-28a915cb-d5af-4a6e-a2bd-c35afcb17bef tempest-TestInstancesWithCinderVolumes-415489405 None] attachment_update completed successfully. Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-8cda98fb-c458-41a0-abb7-e35340c76e80 req-5e67f23c-77c8-4ccd-a046-144fad6bd991 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-8cda98fb-c458-41a0-abb7-e35340c76e80 req-5e67f23c-77c8-4ccd-a046-144fad6bd991 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-8cda98fb-c458-41a0-abb7-e35340c76e80 req-5e67f23c-77c8-4ccd-a046-144fad6bd991 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-8cda98fb-c458-41a0-abb7-e35340c76e80 req-5e67f23c-77c8-4ccd-a046-144fad6bd991 tempest-TestInstancesWithCinderVolumes-415489405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-c67dca1d-f577-4cde-806a-8ee701acdae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07c1dacc-636b-4f8d-b6fa-e074ac2fd002', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-8cda98fb-c458-41a0-abb7-e35340c76e80 req-5e67f23c-77c8-4ccd-a046-144fad6bd991 tempest-TestInstancesWithCinderVolumes-415489405 None] attachment_update completed successfully. Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:48 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:36:48 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:48 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.304s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:36:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:36:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-f27e018c-28ad-416b-8fc5-0f0185ebba30 req-503c800c-d82e-46e1-8187-a173bf4002ba tempest-TestInstancesWithCinderVolumes-415489405 None] Terminate volume connection completed successfully. Nov 05 08:36:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-f27e018c-28ad-416b-8fc5-0f0185ebba30 req-503c800c-d82e-46e1-8187-a173bf4002ba tempest-TestInstancesWithCinderVolumes-415489405 None] Deleting attachment 9d17afaf-200b-4c08-b78a-40380d9427b6. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-7ede6bf3-1364-457b-bc14-a015770ef4fa-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-7ede6bf3-1364-457b-bc14-a015770ef4fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-quobyte-7ede6bf3-1364-457b-bc14-a015770ef4fa" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-7ede6bf3-1364-457b-bc14-a015770ef4fa" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[538cb500-c232-4c1e-8e6a-427cf70dc66f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:53 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa Nov 05 08:36:53 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:53 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa" returned: 0 in 0.366s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:53 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa Nov 05 08:36:53 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:54 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7ede6bf3-1364-457b-bc14-a015770ef4fa" returned: 0 in 0.262s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-7ede6bf3-1364-457b-bc14-a015770ef4fa" released by "delete_volume" :: held 0.676s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:54 devstack cinder-volume[87101]: WARNING cinder.quota [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162560685-1146471705 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162560685-1146471705, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:36:54 devstack cinder-volume[87101]: WARNING cinder.quota [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162560685-1146471705 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162560685-1146471705, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Created reservations ['aef59845-5f67-4c01-bc0c-90cc8385af03', '00a175b0-9910-4545-aed3-ed224299ec56', 'fbfc4dd8-5336-431a-8136-9be0cd88c248', '0bd4b0aa-6cc7-4103-809f-465dfad19480'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:54 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:36:54 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:54 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Deleted volume successfully. Nov 05 08:36:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5bf8fcd8-c936-4554-b057-ddfc5f3fd34a tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-7ede6bf3-1364-457b-bc14-a015770ef4fa-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-a280665d-269b-4fd4-a177-dd90162dc73e req-9dd1923e-6895-4441-b17b-cb2349f4b272 tempest-TestInstancesWithCinderVolumes-415489405 None] Terminate volume connection completed successfully. Nov 05 08:36:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-a280665d-269b-4fd4-a177-dd90162dc73e req-9dd1923e-6895-4441-b17b-cb2349f4b272 tempest-TestInstancesWithCinderVolumes-415489405 None] Deleting attachment 07c1dacc-636b-4f8d-b6fa-e074ac2fd002. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-c67dca1d-f577-4cde-806a-8ee701acdae6-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-c67dca1d-f577-4cde-806a-8ee701acdae6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-quobyte-c67dca1d-f577-4cde-806a-8ee701acdae6" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-c67dca1d-f577-4cde-806a-8ee701acdae6" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe21df-65b0-4fd9-9687-963b3c791a51]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:57 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 Nov 05 08:36:57 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:57 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6" returned: 0 in 0.382s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:57 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6 Nov 05 08:36:57 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:58 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c67dca1d-f577-4cde-806a-8ee701acdae6" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-c67dca1d-f577-4cde-806a-8ee701acdae6" released by "delete_volume" :: held 0.688s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:58 devstack cinder-volume[87101]: WARNING cinder.quota [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063921594-706447649 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063921594-706447649, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:36:58 devstack cinder-volume[87101]: WARNING cinder.quota [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063921594-706447649 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063921594-706447649, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Created reservations ['2eaa6303-af57-4ff5-a926-10008b88d9c4', '56637492-a292-4f30-a223-2893e03e76e8', '2d8757f1-25dd-4191-b882-2e903a440635', '93450608-b86c-4e6f-9fa2-bc5059323aba'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:58 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:36:58 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:58 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Deleted volume successfully. Nov 05 08:36:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-22857151-4795-43a4-93ad-630266936015 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-c67dca1d-f577-4cde-806a-8ee701acdae6-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-a75e8caf-2822-4d94-a416-4f0467204844 req-2953bb16-a0f9-4519-8114-582d64f4a512 tempest-TestInstancesWithCinderVolumes-415489405 None] Terminate volume connection completed successfully. Nov 05 08:37:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-a75e8caf-2822-4d94-a416-4f0467204844 req-2953bb16-a0f9-4519-8114-582d64f4a512 tempest-TestInstancesWithCinderVolumes-415489405 None] Deleting attachment c9f24cac-22cc-4ff3-8ec2-fc5f1daca116. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-a32df91a-d998-4e2d-a679-d0138fd795a7-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-a32df91a-d998-4e2d-a679-d0138fd795a7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "cinder-quobyte-a32df91a-d998-4e2d-a679-d0138fd795a7" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-a32df91a-d998-4e2d-a679-d0138fd795a7" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e4a0d-507a-4f9f-a780-15b82e81e273]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:03 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 Nov 05 08:37:03 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:03 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7" returned: 0 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:03 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7 Nov 05 08:37:03 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:03 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a32df91a-d998-4e2d-a679-d0138fd795a7" returned: 0 in 0.264s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-quobyte-a32df91a-d998-4e2d-a679-d0138fd795a7" released by "delete_volume" :: held 0.670s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:03 devstack cinder-volume[87101]: WARNING cinder.quota [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189864430-1084460224 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189864430-1084460224, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:03 devstack cinder-volume[87101]: WARNING cinder.quota [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189864430-1084460224 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189864430-1084460224, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Created reservations ['1dc8d9f8-370c-4fa3-95c3-6e01da46a7ba', 'bd2d1db6-2310-408b-937f-535559ef4960', '27d81a61-8c77-40fd-9081-14d4cb6ac325', 'c1593e57-3646-410d-a9d9-1ffd667c083e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:03 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:37:03 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:03 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:03 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Deleted volume successfully. Nov 05 08:37:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-755bf57d-bb96-46dc-96dd-2acebb450059 tempest-TestInstancesWithCinderVolumes-415489405 None] Lock "cinder-a32df91a-d998-4e2d-a679-d0138fd795a7-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-e2008f99-3fa3-4196-9f09-8d0f678508a3 req-3c23c324-8c2e-4dbe-97ad-03d06db37b60 tempest-TestMinimumBasicScenario-1510931765 None] Terminate volume connection completed successfully. Nov 05 08:37:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-e2008f99-3fa3-4196-9f09-8d0f678508a3 req-3c23c324-8c2e-4dbe-97ad-03d06db37b60 tempest-TestMinimumBasicScenario-1510931765 None] Deleting attachment 45dc9874-85da-4c44-8b1a-a0cdcadaf8b0. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "cinder-fe862099-b1cf-4dc8-8222-1e9daba90b35-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "cinder-fe862099-b1cf-4dc8-8222-1e9daba90b35-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "cinder-quobyte-fe862099-b1cf-4dc8-8222-1e9daba90b35" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "cinder-quobyte-fe862099-b1cf-4dc8-8222-1e9daba90b35" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd40da4-c458-4226-843c-c8ab73ce0238]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:07 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 Nov 05 08:37:07 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:07 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:07 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35 Nov 05 08:37:07 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:07 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fe862099-b1cf-4dc8-8222-1e9daba90b35" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "cinder-quobyte-fe862099-b1cf-4dc8-8222-1e9daba90b35" released by "delete_volume" :: held 0.696s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Created reservations ['510d4577-db04-4e12-b92d-dd7494420a73', '029279ea-af3f-4425-8f3f-0f6b15ff7f87', '2f2212a4-a7b8-4c6a-9cf1-3329553a3a34', 'd433b848-f7aa-4be0-8e3d-4173932d8a69'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:07 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:37:07 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:07 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Deleted volume successfully. Nov 05 08:37:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c95fd616-fa11-4871-a08c-68a545abc12b tempest-TestMinimumBasicScenario-1510931765 None] Lock "cinder-fe862099-b1cf-4dc8-8222-1e9daba90b35-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:17 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:37:17 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=41,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:37:26 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:37:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Flow 'volume_create_manager' (e9856b76-be62-43b6-bc12-9faf8a830728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4272689-4333-4d8e-bafe-498369e8a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4272689-4333-4d8e-bafe-498369e8a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f6ea6b81d4451a23422249b6dbd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:27Z,use_quota=True,user_id='6b8d5d1481924a9992539ccb1ed90490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(108b9260-ead5-47ca-a824-3b8161ee1a3c),volume_type_id=108b9260-ead5-47ca-a824-3b8161ee1a3c)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e7140a-18b4-41bb-8a7f-1d7042b7a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e7140a-18b4-41bb-8a7f-1d7042b7a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c19c3-54be-466f-b070-a3f71d0e0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c19c3-54be-466f-b070-a3f71d0e0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191', 'volume_name': 'volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191', 'volume_size': 1, 'image_id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce5b744efb0649e503ce411a684e4806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '971f6ea6b81d4451a23422249b6dbd87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff6cb69094d41cdb7b19391b12450be8fd7ae675730f20cf44917045b0be1bc09557176bf78c7cc98fb1fc179c17c39f3f4b3ae64b0aa28ddaec3cd48bc8a224', 'id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2968260-208d-4898-98f2-b3a1122ee7bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27195d5a-a3f0-4e69-8abc-4182cdcff6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27195d5a-a3f0-4e69-8abc-4182cdcff6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8b56a-33fd-41af-9dcf-59982d927de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191', 'volume_size': 1, 'image_id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce5b744efb0649e503ce411a684e4806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '971f6ea6b81d4451a23422249b6dbd87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff6cb69094d41cdb7b19391b12450be8fd7ae675730f20cf44917045b0be1bc09557176bf78c7cc98fb1fc179c17c39f3f4b3ae64b0aa28ddaec3cd48bc8a224', 'id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2968260-208d-4898-98f2-b3a1122ee7bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Trying to clone 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 from image f2968260-208d-4898-98f2-b3a1122ee7bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:37:27 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[27710e4d-d4d5-4c47-b276-ae6f6c4f1b6b]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:27 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:27 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:27 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:28 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:28 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:28 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Temporary image f2968260-208d-4898-98f2-b3a1122ee7bf is fetched for user 6b8d5d1481924a9992539ccb1ed90490. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39cc63d-918c-4934-94b8-a34ff76eec33]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:28 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:28 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:28 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:28 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:28 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:29 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f6ea6b81d4451a23422249b6dbd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:27Z,use_quota=True,user_id='6b8d5d1481924a9992539ccb1ed90490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(108b9260-ead5-47ca-a824-3b8161ee1a3c),volume_type_id=108b9260-ead5-47ca-a824-3b8161ee1a3c)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Creating volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:37:29 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:29 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1073741824 Nov 05 08:37:29 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:29 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1073741824" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:29 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 Nov 05 08:37:29 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:29 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Attempting download of f2968260-208d-4898-98f2-b3a1122ee7bf ((None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}])) to volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fc8b07-ef9e-49ee-bbef-65e8de7b885c]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:30 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn Nov 05 08:37:30 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:30 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn" returned: 0 in 0.410s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:30 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn Nov 05 08:37:30 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:30 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn" returned: 1 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2968260-208d-4898-98f2-b3a1122ee7bf_ahbajnrn' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed14aa01-7b8f-4715-942e-83a335e50087]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:30 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:30 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:31 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:31 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD Nov 05 08:37:31 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:31 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] f2968260-208d-4898-98f2-b3a1122ee7bf was raw, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:31 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 Nov 05 08:37:31 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:31 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" returned: 0 in 0.511s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f2968260-208d-4898-98f2-b3a1122ee7bf_t5052y9pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:37:31 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:37:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:31 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1G Nov 05 08:37:31 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:32 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 1G" returned: 0 in 0.389s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Downloaded image f2968260-208d-4898-98f2-b3a1122ee7bf ((None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}])) to volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Temporary image f2968260-208d-4898-98f2-b3a1122ee7bf for user 6b8d5d1481924a9992539ccb1ed90490 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Marking volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Copying metadata from image f2968260-208d-4898-98f2-b3a1122ee7bf to 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Creating volume glance metadata for volume 15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 backed by image f2968260-208d-4898-98f2-b3a1122ee7bf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ce5b744efb0649e503ce411a684e4806', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8b56a-33fd-41af-9dcf-59982d927de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191', 'volume_size': 1, 'image_id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2968260-208d-4898-98f2-b3a1122ee7bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce5b744efb0649e503ce411a684e4806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '971f6ea6b81d4451a23422249b6dbd87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff6cb69094d41cdb7b19391b12450be8fd7ae675730f20cf44917045b0be1bc09557176bf78c7cc98fb1fc179c17c39f3f4b3ae64b0aa28ddaec3cd48bc8a224', 'id': 'f2968260-208d-4898-98f2-b3a1122ee7bf', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2968260-208d-4898-98f2-b3a1122ee7bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dcf798-2d33-4288-bb9b-8dd818a7ec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:32 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Volume volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 (15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191): created successfully Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dcf798-2d33-4288-bb9b-8dd818a7ec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:32 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Flow 'volume_create_manager' (e9856b76-be62-43b6-bc12-9faf8a830728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:32 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a8f026a2-85eb-4d59-afb4-34f654adb393 tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Created volume successfully. Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Acquiring lock "cinder-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "cinder-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Acquiring lock "cinder-quobyte-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "cinder-quobyte-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f376989-bffd-4bcb-8835-ddb8a0f87aa5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:33 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 Nov 05 08:37:33 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:33 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:33 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191 Nov 05 08:37:33 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:34 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "cinder-quobyte-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191" released by "delete_volume" :: held 0.698s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:34 devstack cinder-volume[87101]: WARNING cinder.quota [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:34 devstack cinder-volume[87101]: WARNING cinder.quota [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Created reservations ['1cde3a1f-5b3e-4091-907f-1ccfa8901855', '4f5677b5-2411-48b5-9a87-2181f9d5bbf4', '5c0f9cad-519b-468d-b935-93bdd9f5532f', 'ba4084cf-5e0f-4663-a579-bd6bb606eecb'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:34 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:37:34 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:34 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Deleted volume successfully. Nov 05 08:37:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c2faa10-3de1-40dd-95da-09a20c9995fb tempest-VolumeAndVolumeTypeFromImageTest-1731743208 None] Lock "cinder-15e2dbb7-5c95-4f10-87f9-5d1c9ebc8191-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Flow 'volume_create_manager' (c8aab643-c61c-45e5-a4fa-0eb8650c9d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb2c574-5582-4285-a603-10d3bf27f992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb2c574-5582-4285-a603-10d3bf27f992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2142912360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b397a910-d326-4fe0-bb43-93693cb39cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782d86e2f63d44a68b2732b2041b192f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:39Z,use_quota=True,user_id='1273255ed3e44407b5d373c084dbf42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1160e33-d041-4c4e-9bd2-4930266cc695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1160e33-d041-4c4e-9bd2-4930266cc695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b0abe-4ad6-40a5-b32b-0819f74b9612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b0abe-4ad6-40a5-b32b-0819f74b9612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b397a910-d326-4fe0-bb43-93693cb39cf1', 'volume_name': 'volume-b397a910-d326-4fe0-bb43-93693cb39cf1', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293cf513-317b-44b6-8b94-3cd8def8a248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293cf513-317b-44b6-8b94-3cd8def8a248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e42924-9f10-4ec6-85d5-daf2d8ba7260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Volume b397a910-d326-4fe0-bb43-93693cb39cf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b397a910-d326-4fe0-bb43-93693cb39cf1', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:37:39 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Trying to clone b397a910-d326-4fe0-bb43-93693cb39cf1 from image 0f972b89-5809-49af-bb61-4f969e240750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:37:40 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[94906fb3-21b3-4c7f-9dc3-7e61ba5862bd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:40 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD Nov 05 08:37:40 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:40 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 is fetched for user 1273255ed3e44407b5d373c084dbf42e. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec521d2-373d-49a9-8ad0-0eadd5045fd6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:40 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD Nov 05 08:37:40 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:40 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2142912360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b397a910-d326-4fe0-bb43-93693cb39cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782d86e2f63d44a68b2732b2041b192f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:39Z,use_quota=True,user_id='1273255ed3e44407b5d373c084dbf42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Creating volume b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:37:40 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:37:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:40 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1073741824 Nov 05 08:37:40 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:41 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1073741824" returned: 0 in 0.468s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:41 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 Nov 05 08:37:41 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:41 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Attempting download of 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume b397a910-d326-4fe0-bb43-93693cb39cf1. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2c6599-a599-4177-91df-21590a76b951]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:41 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j Nov 05 08:37:41 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:42 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Flow 'volume_create_manager' (b306133c-f5e1-49ef-9ef8-b1cc3c4116ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b6afb1-fb7f-4009-812a-5fee3460e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b6afb1-fb7f-4009-812a-5fee3460e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d58cc10-9a46-4c24-83f0-0a47e3b991a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0595b5eb678242759bf279bfa516a15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:42Z,use_quota=True,user_id='30a429761e134e4580eb16bee72a3706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69da849-e3fc-46ba-a130-dfac77d632cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69da849-e3fc-46ba-a130-dfac77d632cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df589be-c3c6-498f-8184-0383e0bec49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:37:42 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j Nov 05 08:37:42 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df589be-c3c6-498f-8184-0383e0bec49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d58cc10-9a46-4c24-83f0-0a47e3b991a1', 'volume_name': 'volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1', 'volume_size': 1, 'image_id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bb376c19c4340e0f5a42435b79cd594', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0595b5eb678242759bf279bfa516a15e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d15ada6e42e7b8a9f924fe4196197c4182fa1b3b52ee23d018da2c24ddab594f461d8cb85de400a0c1c4986b98a0bb2ff19fc69125e1896101b35f1b2a6e8e8', 'id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21086198-f81a-47f5-9d2a-4a555ee04f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21086198-f81a-47f5-9d2a-4a555ee04f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8302405e-9771-408e-8551-24a0b08a8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:42 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1', 'volume_size': 1, 'image_id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bb376c19c4340e0f5a42435b79cd594', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0595b5eb678242759bf279bfa516a15e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d15ada6e42e7b8a9f924fe4196197c4182fa1b3b52ee23d018da2c24ddab594f461d8cb85de400a0c1c4986b98a0bb2ff19fc69125e1896101b35f1b2a6e8e8', 'id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c/file', 'properties': {}}, 'image_service': } Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Trying to clone 6d58cc10-9a46-4c24-83f0-0a47e3b991a1 from image c9331bb2-b8b0-4cc3-b24d-de07570c255c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:37:42 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j" returned: 1 in 0.326s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f972b89-5809-49af-bb61-4f969e240750_qnttig5j' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264166c-6dda-4869-bb65-72aed57e5a00]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:37:42 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:37:42 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD Nov 05 08:37:42 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba5fe3-d7a9-4b84-9856-2961389eec70]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:42 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:42 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:42 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] 0f972b89-5809-49af-bb61-4f969e240750 was qcow2, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:42 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 Nov 05 08:37:42 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:42 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:42 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:42 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:43 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Temporary image c9331bb2-b8b0-4cc3-b24d-de07570c255c is fetched for user 30a429761e134e4580eb16bee72a3706. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208efaf-fc1c-4d18-a57f-68490cc83584]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:43 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:43 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:43 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:43 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:43 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:44 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d58cc10-9a46-4c24-83f0-0a47e3b991a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0595b5eb678242759bf279bfa516a15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:37:42Z,use_quota=True,user_id='30a429761e134e4580eb16bee72a3706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Creating volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:37:44 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:44 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1073741824 Nov 05 08:37:44 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:44 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1073741824" returned: 0 in 0.477s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:44 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 Nov 05 08:37:44 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:44 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1" returned: 0 in 1.882s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f972b89-5809-49af-bb61-4f969e240750_useohfwddevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:37:44 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Converted 112.00 MB image at 59.45 MB/s Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:44 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1G Nov 05 08:37:44 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:44 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" returned: 0 in 0.247s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Attempting download of c9331bb2-b8b0-4cc3-b24d-de07570c255c ((None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}])) to volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[60164375-2b3b-4393-b3aa-8fd4d3b07649]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:44 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 1G" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Downloaded image 0f972b89-5809-49af-bb61-4f969e240750 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}])) to volume b397a910-d326-4fe0-bb43-93693cb39cf1 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Temporary image 0f972b89-5809-49af-bb61-4f969e240750 for user 1273255ed3e44407b5d373c084dbf42e is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Marking volume b397a910-d326-4fe0-bb43-93693cb39cf1 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:37:44 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Copying metadata from image 0f972b89-5809-49af-bb61-4f969e240750 to b397a910-d326-4fe0-bb43-93693cb39cf1. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Creating volume glance metadata for volume b397a910-d326-4fe0-bb43-93693cb39cf1 backed by image 0f972b89-5809-49af-bb61-4f969e240750 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:37:45 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj Nov 05 08:37:45 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e42924-9f10-4ec6-85d5-daf2d8ba7260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b397a910-d326-4fe0-bb43-93693cb39cf1', 'volume_size': 1, 'image_id': '0f972b89-5809-49af-bb61-4f969e240750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f972b89-5809-49af-bb61-4f969e240750', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7896b27a8a934b958c44e7619a0abf3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f972b89-5809-49af-bb61-4f969e240750', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f972b89-5809-49af-bb61-4f969e240750/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35747b0d-5e6c-46e0-99da-193ec65a0183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Volume volume-b397a910-d326-4fe0-bb43-93693cb39cf1 (b397a910-d326-4fe0-bb43-93693cb39cf1): created successfully Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35747b0d-5e6c-46e0-99da-193ec65a0183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Flow 'volume_create_manager' (c8aab643-c61c-45e5-a4fa-0eb8650c9d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b595ea8e-e01d-4d50-9de3-3f50cfc6db79 tempest-TestShelveInstance-1724796230 None] Created volume successfully. Nov 05 08:37:45 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj" returned: 0 in 0.329s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:45 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj Nov 05 08:37:45 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:45 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj" returned: 1 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9331bb2-b8b0-4cc3-b24d-de07570c255c_jlfvighj' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e97d66-254c-4b42-8a3f-96621b4bef13]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:45 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:45 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:45 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:46 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD Nov 05 08:37:46 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:46 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] c9331bb2-b8b0-4cc3-b24d-de07570c255c was raw, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:46 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 Nov 05 08:37:46 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:46 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" returned: 0 in 0.509s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9331bb2-b8b0-4cc3-b24d-de07570c255c_do5o9465devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:37:46 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:37:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:46 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1G Nov 05 08:37:46 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:47 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 1G" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Downloaded image c9331bb2-b8b0-4cc3-b24d-de07570c255c ((None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}])) to volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Temporary image c9331bb2-b8b0-4cc3-b24d-de07570c255c for user 30a429761e134e4580eb16bee72a3706 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Marking volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Copying metadata from image c9331bb2-b8b0-4cc3-b24d-de07570c255c to 6d58cc10-9a46-4c24-83f0-0a47e3b991a1. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Creating volume glance metadata for volume 6d58cc10-9a46-4c24-83f0-0a47e3b991a1 backed by image c9331bb2-b8b0-4cc3-b24d-de07570c255c with: {'image_id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0bb376c19c4340e0f5a42435b79cd594', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8302405e-9771-408e-8551-24a0b08a8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1', 'volume_size': 1, 'image_id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bb376c19c4340e0f5a42435b79cd594', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0595b5eb678242759bf279bfa516a15e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d15ada6e42e7b8a9f924fe4196197c4182fa1b3b52ee23d018da2c24ddab594f461d8cb85de400a0c1c4986b98a0bb2ff19fc69125e1896101b35f1b2a6e8e8', 'id': 'c9331bb2-b8b0-4cc3-b24d-de07570c255c', 'created_at': datetime.datetime(2026, 11, 5, 7, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9331bb2-b8b0-4cc3-b24d-de07570c255c/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cfd33f-dc3d-4d80-b3fe-f3e35448c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:37:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Volume volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 (6d58cc10-9a46-4c24-83f0-0a47e3b991a1): created successfully Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cfd33f-dc3d-4d80-b3fe-f3e35448c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Flow 'volume_create_manager' (b306133c-f5e1-49ef-9ef8-b1cc3c4116ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:37:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-416688c8-2b01-44e8-94e4-9eb2da17c424 tempest-VolumeImageDependencyTests-1591524686 None] Created volume successfully. Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Acquiring lock "cinder-6d58cc10-9a46-4c24-83f0-0a47e3b991a1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "cinder-6d58cc10-9a46-4c24-83f0-0a47e3b991a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Acquiring lock "cinder-quobyte-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "cinder-quobyte-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd4c468-be64-44b1-b9c4-d4f78c62eb33]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:47 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 Nov 05 08:37:47 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:47 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:47 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1 Nov 05 08:37:47 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:48 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "cinder-quobyte-6d58cc10-9a46-4c24-83f0-0a47e3b991a1" released by "delete_volume" :: held 0.742s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Created reservations ['0002d15b-63ca-4e60-891e-2b046814fbc4', '1fff9052-e949-4b84-835b-87ad90c4a191', '5c359b55-4d57-4245-8644-bf3fbe4c5e8c', '61bbed1d-a512-44d9-91e1-867b9d1cab61'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:48 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:37:48 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-d4a7aca9-ad27-4160-b6e2-7a587997ed91 req-a834cb97-68ce-42ba-80b1-8ecf8cca40e5 tempest-TestShelveInstance-1724796230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-d4a7aca9-ad27-4160-b6e2-7a587997ed91 req-a834cb97-68ce-42ba-80b1-8ecf8cca40e5 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:48 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:37:48 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-d4a7aca9-ad27-4160-b6e2-7a587997ed91 req-a834cb97-68ce-42ba-80b1-8ecf8cca40e5 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-d4a7aca9-ad27-4160-b6e2-7a587997ed91 req-a834cb97-68ce-42ba-80b1-8ecf8cca40e5 tempest-TestShelveInstance-1724796230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-b397a910-d326-4fe0-bb43-93693cb39cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d68a026-d48c-47d3-9d7c-e351ecf2e74d', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:37:48 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.324s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Deleted volume successfully. Nov 05 08:37:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-d4a7aca9-ad27-4160-b6e2-7a587997ed91 req-a834cb97-68ce-42ba-80b1-8ecf8cca40e5 tempest-TestShelveInstance-1724796230 None] attachment_update completed successfully. Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10ff2f39-c63f-41d7-b0b5-90062f698fe7 tempest-VolumeImageDependencyTests-1591524686 None] Lock "cinder-6d58cc10-9a46-4c24-83f0-0a47e3b991a1-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:48 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:37:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:37:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:37:58 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=30,cinder:SELECT=48,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:37:58 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=35,cinder:INSERT=27,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-6ebe3ec1-d5c7-4c77-9e72-e111dc91c360 req-b017c792-e8a1-4993-9d32-e156c4df17c9 tempest-TestShelveInstance-1724796230 None] Terminate volume connection completed successfully. Nov 05 08:38:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-6ebe3ec1-d5c7-4c77-9e72-e111dc91c360 req-b017c792-e8a1-4993-9d32-e156c4df17c9 tempest-TestShelveInstance-1724796230 None] Deleting attachment 3d68a026-d48c-47d3-9d7c-e351ecf2e74d. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:38:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7b809c67-6edb-4a7a-be8a-0254f034dee6 req-7fa4f558-42f9-49df-b287-9a378941d392 tempest-TestShelveInstance-1724796230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7b809c67-6edb-4a7a-be8a-0254f034dee6 req-7fa4f558-42f9-49df-b287-9a378941d392 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7b809c67-6edb-4a7a-be8a-0254f034dee6 req-7fa4f558-42f9-49df-b287-9a378941d392 tempest-TestShelveInstance-1724796230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-7b809c67-6edb-4a7a-be8a-0254f034dee6 req-7fa4f558-42f9-49df-b287-9a378941d392 tempest-TestShelveInstance-1724796230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61', 'name': 'volume-b397a910-d326-4fe0-bb43-93693cb39cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f6453c-77b9-475b-a411-b2dc05164481', 'enforce_multipath': True} {{(pid=87101) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:38:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-7b809c67-6edb-4a7a-be8a-0254f034dee6 req-7fa4f558-42f9-49df-b287-9a378941d392 tempest-TestShelveInstance-1724796230 None] attachment_update completed successfully. Nov 05 08:38:31 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:31 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:48 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:38:48 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:48 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:38:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:39:04 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-7edf5815-e6c1-434f-bac3-38329384f18e req-aae8d40a-8e04-40ce-bc10-317d1216b4a4 tempest-TestShelveInstance-1724796230 None] Terminate volume connection completed successfully. Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [req-7edf5815-e6c1-434f-bac3-38329384f18e req-aae8d40a-8e04-40ce-bc10-317d1216b4a4 tempest-TestShelveInstance-1724796230 None] Deleting attachment 92f6453c-77b9-475b-a411-b2dc05164481. {{(pid=87101) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Acquiring lock "cinder-b397a910-d326-4fe0-bb43-93693cb39cf1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "cinder-b397a910-d326-4fe0-bb43-93693cb39cf1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Acquiring lock "cinder-quobyte-b397a910-d326-4fe0-bb43-93693cb39cf1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "cinder-quobyte-b397a910-d326-4fe0-bb43-93693cb39cf1" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e49afb-6e36-4659-bc08-1016b5a926de]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:04 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 Nov 05 08:39:04 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:04 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1" returned: 0 in 0.385s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:04 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1 Nov 05 08:39:04 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:05 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b397a910-d326-4fe0-bb43-93693cb39cf1" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "cinder-quobyte-b397a910-d326-4fe0-bb43-93693cb39cf1" released by "delete_volume" :: held 0.676s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.quota [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Created reservations ['97aada44-f744-4439-b4a8-c29384b234b0', '8a917df7-2cef-49de-9a7f-67862782fc93', '8857801d-46a3-4141-b990-bdc4eeff4440', '5413f6ff-a605-491d-a3cb-96c4e95572aa'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:05 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:05 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:05 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.manager [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Deleted volume successfully. Nov 05 08:39:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [req-7edf5815-e6c1-434f-bac3-38329384f18e req-7b2bb49a-3195-4ebd-8b32-46c452264452 tempest-TestShelveInstance-1724796230 None] Lock "cinder-b397a910-d326-4fe0-bb43-93693cb39cf1-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (8f0e35e0-d126-464f-8515-c059bc9f49dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f33843a-1262-4c09-b6b4-d9bd7f3a8924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f33843a-1262-4c09-b6b4-d9bd7f3a8924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250619797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b6940-550c-4c9d-87ec-883132150fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca11d88-f23b-4306-8fbd-cb39a2b92d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca11d88-f23b-4306-8fbd-cb39a2b92d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf1cc28-38b1-44da-85e6-0d45b8898e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf1cc28-38b1-44da-85e6-0d45b8898e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2b6940-550c-4c9d-87ec-883132150fe3', 'volume_name': 'volume-fa2b6940-550c-4c9d-87ec-883132150fe3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c5ce05-ba9c-4731-be6c-5f6d6d41e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c5ce05-ba9c-4731-be6c-5f6d6d41e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa338f97-b535-41df-afdd-060d24347c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Volume fa2b6940-550c-4c9d-87ec-883132150fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2b6940-550c-4c9d-87ec-883132150fe3', 'volume_size': 1} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250619797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b6940-550c-4c9d-87ec-883132150fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Creating volume fa2b6940-550c-4c9d-87ec-883132150fe3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:16 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:16 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 1073741824 Nov 05 08:39:16 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (5fcbae38-25c2-4625-ac87-1b9c618dac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5e60b7-5097-499c-a095-b59e7e4856ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5e60b7-5097-499c-a095-b59e7e4856ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1000151944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f440c0e9-d571-4ddf-8d2c-5ffab103d5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b5403a-2625-4478-8f97-8f54ddc43aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b5403a-2625-4478-8f97-8f54ddc43aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8142b4-55a1-4d70-9c39-c22db1a7b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8142b4-55a1-4d70-9c39-c22db1a7b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f440c0e9-d571-4ddf-8d2c-5ffab103d5c5', 'volume_name': 'volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befbce4d-6f2b-49b4-94dc-72685ff1cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befbce4d-6f2b-49b4-94dc-72685ff1cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e52fec-1bc6-407c-9623-3c52ba2610d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Volume f440c0e9-d571-4ddf-8d2c-5ffab103d5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5', 'volume_size': 1} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:17 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 1073741824" returned: 0 in 0.547s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:17 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 Nov 05 08:39:17 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (996a222f-5729-4f53-9eeb-55b7a60b24dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b236ab16-a635-47aa-8ef3-9b3c6114c239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b236ab16-a635-47aa-8ef3-9b3c6114c239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738025629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3408439-3d92-46a8-b52e-8776de59dbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c464957-8dfe-4786-af11-06ff35edb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c464957-8dfe-4786-af11-06ff35edb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762d54d3-b4bb-4c33-91a7-0e353cddba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762d54d3-b4bb-4c33-91a7-0e353cddba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3408439-3d92-46a8-b52e-8776de59dbdd', 'volume_name': 'volume-c3408439-3d92-46a8-b52e-8776de59dbdd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f9c7cb-d72f-480f-97eb-421571c7c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f9c7cb-d72f-480f-97eb-421571c7c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f825874-3d88-4d85-b783-8006478cb611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Volume c3408439-3d92-46a8-b52e-8776de59dbdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3408439-3d92-46a8-b52e-8776de59dbdd', 'volume_size': 1} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:17 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3" returned: 0 in 0.280s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1000151944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f440c0e9-d571-4ddf-8d2c-5ffab103d5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Creating volume f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:17 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa338f97-b535-41df-afdd-060d24347c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2b6940-550c-4c9d-87ec-883132150fe3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 1073741824 Nov 05 08:39:17 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2eca461-bcb7-4834-a988-8956dab882d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Volume volume-fa2b6940-550c-4c9d-87ec-883132150fe3 (fa2b6940-550c-4c9d-87ec-883132150fe3): created successfully Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2eca461-bcb7-4834-a988-8956dab882d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (8f0e35e0-d126-464f-8515-c059bc9f49dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-564b31a1-6e85-4df6-a64f-6cb6781362dc tempest-CreateVolumesFromImageTest-135318040 None] Created volume successfully. Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (b6ddbf72-5b49-4c38-a127-3a3cd3b076a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18efcfd-c43d-4544-a690-7633c860e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18efcfd-c43d-4544-a690-7633c860e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-720761863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffe01a1-d987-4c80-b640-d77ec3444934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:18Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926e97c7-fe70-43a0-9bbc-46d1470de3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926e97c7-fe70-43a0-9bbc-46d1470de3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f26de-d513-4bb4-ac1e-7f1532fd5017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f26de-d513-4bb4-ac1e-7f1532fd5017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffe01a1-d987-4c80-b640-d77ec3444934', 'volume_name': 'volume-3ffe01a1-d987-4c80-b640-d77ec3444934', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414086ab-835b-4ccc-9aa6-63b63f0196b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414086ab-835b-4ccc-9aa6-63b63f0196b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68014d12-e00d-4cbc-afc0-987cc0edda2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Volume 3ffe01a1-d987-4c80-b640-d77ec3444934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffe01a1-d987-4c80-b640-d77ec3444934', 'volume_size': 1} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:18 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (79a1b1d6-012e-46a2-bbb2-cfd8e8e658eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2e8f4d-8f6a-454b-b36c-148db6e77f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 1073741824" returned: 0 in 0.608s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2e8f4d-8f6a-454b-b36c-148db6e77f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997092147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1db27c-a552-46c0-b580-5a175f3447a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:18Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4bbf0-ab10-4e64-8e13-6419f74c5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4bbf0-ab10-4e64-8e13-6419f74c5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92267e96-0045-4334-8b88-f78321122616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92267e96-0045-4334-8b88-f78321122616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1db27c-a552-46c0-b580-5a175f3447a5', 'volume_name': 'volume-9b1db27c-a552-46c0-b580-5a175f3447a5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b836787-9607-447c-94d7-d54c9709aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b836787-9607-447c-94d7-d54c9709aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948258f2-8a65-4679-929d-b4c98cc53601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Volume 9b1db27c-a552-46c0-b580-5a175f3447a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1db27c-a552-46c0-b580-5a175f3447a5', 'volume_size': 1} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:18 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 Nov 05 08:39:18 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:18 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738025629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3408439-3d92-46a8-b52e-8776de59dbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:17Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Creating volume c3408439-3d92-46a8-b52e-8776de59dbdd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:18 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:18 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd 1073741824 Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e52fec-1bc6-407c-9623-3c52ba2610d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d74cfb-fd5e-4cf6-874f-9817f23217ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Volume volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 (f440c0e9-d571-4ddf-8d2c-5ffab103d5c5): created successfully Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d74cfb-fd5e-4cf6-874f-9817f23217ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (5fcbae38-25c2-4625-ac87-1b9c618dac47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-345122ab-4751-471b-a7cf-a22da82c2c64 tempest-CreateVolumesFromImageTest-135318040 None] Created volume successfully. Nov 05 08:39:19 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd 1073741824" returned: 0 in 0.411s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:19 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd Nov 05 08:39:19 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:19 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-720761863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffe01a1-d987-4c80-b640-d77ec3444934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:18Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Creating volume 3ffe01a1-d987-4c80-b640-d77ec3444934 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:19 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f825874-3d88-4d85-b783-8006478cb611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3408439-3d92-46a8-b52e-8776de59dbdd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44304b73-ec74-4dea-8a2d-7d221ea585a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:19 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 1073741824 Nov 05 08:39:19 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:19 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Volume volume-c3408439-3d92-46a8-b52e-8776de59dbdd (c3408439-3d92-46a8-b52e-8776de59dbdd): created successfully Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44304b73-ec74-4dea-8a2d-7d221ea585a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (996a222f-5729-4f53-9eeb-55b7a60b24dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4b60fd31-4008-451f-a132-55efcdd001cb tempest-CreateVolumesFromImageTest-135318040 None] Created volume successfully. Nov 05 08:39:19 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 1073741824" returned: 0 in 0.408s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:19 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 Nov 05 08:39:19 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:20 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997092147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1db27c-a552-46c0-b580-5a175f3447a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19772df426c4909ad49cbf0a24f4566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:18Z,use_quota=True,user_id='856237b8cb9e498090aee8d320c686e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Creating volume 9b1db27c-a552-46c0-b580-5a175f3447a5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:20 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68014d12-e00d-4cbc-afc0-987cc0edda2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffe01a1-d987-4c80-b640-d77ec3444934', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c068e045-a1fc-4457-b719-29a8313bfd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:20 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 1073741824 Nov 05 08:39:20 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Volume volume-3ffe01a1-d987-4c80-b640-d77ec3444934 (3ffe01a1-d987-4c80-b640-d77ec3444934): created successfully Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c068e045-a1fc-4457-b719-29a8313bfd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (b6ddbf72-5b49-4c38-a127-3a3cd3b076a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-042f57ea-bfc1-48cd-98f9-b4e2800cbfeb tempest-CreateVolumesFromImageTest-135318040 None] Created volume successfully. Nov 05 08:39:20 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 1073741824" returned: 0 in 0.436s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:20 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 Nov 05 08:39:20 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:20 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948258f2-8a65-4679-929d-b4c98cc53601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1db27c-a552-46c0-b580-5a175f3447a5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ba6ee0-14cf-44d1-bbf4-f2ebd1e9367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Volume volume-9b1db27c-a552-46c0-b580-5a175f3447a5 (9b1db27c-a552-46c0-b580-5a175f3447a5): created successfully Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ba6ee0-14cf-44d1-bbf4-f2ebd1e9367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Flow 'volume_create_manager' (79a1b1d6-012e-46a2-bbb2-cfd8e8e658eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8be01448-3cc5-4cab-aa6b-075d663407bc tempest-CreateVolumesFromImageTest-135318040 None] Created volume successfully. Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-9b1db27c-a552-46c0-b580-5a175f3447a5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-9b1db27c-a552-46c0-b580-5a175f3447a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-quobyte-9b1db27c-a552-46c0-b580-5a175f3447a5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-9b1db27c-a552-46c0-b580-5a175f3447a5" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34bfb6-d212-4bb2-8de6-8e67f217414e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:21 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 Nov 05 08:39:21 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:22 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:22 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5 Nov 05 08:39:22 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:22 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9b1db27c-a552-46c0-b580-5a175f3447a5" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-9b1db27c-a552-46c0-b580-5a175f3447a5" released by "delete_volume" :: held 0.630s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Created reservations ['3732c94d-39e6-47a8-9573-0d2f6080fa59', '486c5354-fdf8-45e5-bb28-d7ff4681b8c5', 'b67e574e-b251-4e75-9349-9cce14a9960e', 'b797dcc8-a338-4d81-902d-47a42fd39d9f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:22 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:22 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:22 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.236s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:22 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Deleted volume successfully. Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c3f7da35-31ab-46ce-97fb-275f0103060f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-9b1db27c-a552-46c0-b580-5a175f3447a5-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-3ffe01a1-d987-4c80-b640-d77ec3444934-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-3ffe01a1-d987-4c80-b640-d77ec3444934-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-quobyte-3ffe01a1-d987-4c80-b640-d77ec3444934" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-3ffe01a1-d987-4c80-b640-d77ec3444934" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db31657-4525-48a3-9364-873d8c071801]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:23 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 Nov 05 08:39:23 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:23 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934" returned: 0 in 0.345s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:23 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934 Nov 05 08:39:23 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:23 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-3ffe01a1-d987-4c80-b640-d77ec3444934" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-3ffe01a1-d987-4c80-b640-d77ec3444934" released by "delete_volume" :: held 0.626s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Created reservations ['b4d5cf3b-eeb9-4a15-8d90-9130a3daeae7', 'fc01802c-68cc-44ad-b288-18a2b8a5678f', '1c6fc75d-768b-433e-b5c6-c25ebe78edc9', '3d63f273-4922-4462-bdd5-acb997af44c5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:23 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:23 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:23 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Deleted volume successfully. Nov 05 08:39:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb323fd4-e2a7-4512-aac0-1ccea3aeae91 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-3ffe01a1-d987-4c80-b640-d77ec3444934-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-c3408439-3d92-46a8-b52e-8776de59dbdd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-c3408439-3d92-46a8-b52e-8776de59dbdd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-quobyte-c3408439-3d92-46a8-b52e-8776de59dbdd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-c3408439-3d92-46a8-b52e-8776de59dbdd" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee911610-d7f0-41d2-867e-88e7f5104894]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:24 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd Nov 05 08:39:24 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:24 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:24 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd Nov 05 08:39:24 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:24 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c3408439-3d92-46a8-b52e-8776de59dbdd" returned: 0 in 0.235s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-c3408439-3d92-46a8-b52e-8776de59dbdd" released by "delete_volume" :: held 0.627s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Created reservations ['60185f85-45c6-49a6-bc72-54acb5954364', '447535af-e3cd-443b-86fa-bf885299d4d7', '59ef8357-6330-4eee-9c44-3ddfd5c19fb1', '4aee6fee-5cd5-4f82-b707-f2e405ff1eff'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:24 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:24 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:25 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:25 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Deleted volume successfully. Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bf31dbe4-ec8f-4828-91c7-4e358ec2d82f tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-c3408439-3d92-46a8-b52e-8776de59dbdd-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-quobyte-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c55db-b716-4cd4-934c-86653f88d9e4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:25 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 Nov 05 08:39:25 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:25 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" returned: 0 in 0.363s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:25 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5 Nov 05 08:39:25 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:25 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5" released by "delete_volume" :: held 0.642s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Created reservations ['7b93388d-ff08-4311-9bfb-f0b6c911671d', '5e51a24f-bf4c-40d3-86cb-043856844127', '677d6ad4-7b11-4c09-8d28-f8de8c683c5f', '98bbd5b2-5c07-475f-8048-77a879866b9e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:26 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:26 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:26 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Deleted volume successfully. Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f8fb5795-8ec6-4815-852f-479c86274be2 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-f440c0e9-d571-4ddf-8d2c-5ffab103d5c5-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-fa2b6940-550c-4c9d-87ec-883132150fe3-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-fa2b6940-550c-4c9d-87ec-883132150fe3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "cinder-quobyte-fa2b6940-550c-4c9d-87ec-883132150fe3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-fa2b6940-550c-4c9d-87ec-883132150fe3" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc79886-6c17-4598-bb47-a7b0151b433f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:26 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 Nov 05 08:39:26 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:26 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:26 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3 Nov 05 08:39:26 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:27 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fa2b6940-550c-4c9d-87ec-883132150fe3" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-quobyte-fa2b6940-550c-4c9d-87ec-883132150fe3" released by "delete_volume" :: held 0.645s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Created reservations ['c95cb79c-4e30-4d4f-8914-486bd68ffd88', 'cb36d205-5188-4d5f-bffc-3630f6aefba3', 'b98c59ae-174c-43a2-a417-727a287a34a8', '466afdb5-c79d-4461-a667-a9064d5c22cd'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:27 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:27 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:27 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Deleted volume successfully. Nov 05 08:39:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-26daef11-ab37-4422-8eb8-25503ece2b53 tempest-CreateVolumesFromImageTest-135318040 None] Lock "cinder-fa2b6940-550c-4c9d-87ec-883132150fe3-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Flow 'volume_create_manager' (4469d2ab-0cb9-4909-9f82-291a94f9cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808c48bf-27b9-430e-9f94-a03e79600f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808c48bf-27b9-430e-9f94-a03e79600f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2104325412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf473d9-b790-4e6a-8818-4940ae9e7175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d85023653184b75b60bd9cd08cacb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:30Z,use_quota=True,user_id='0f2e5c5fcc2b493ebe04b9bb92626489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede38652-a28a-431c-b795-055fc0d2607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede38652-a28a-431c-b795-055fc0d2607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64040c-3119-452b-ab79-766ade0fb6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64040c-3119-452b-ab79-766ade0fb6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf473d9-b790-4e6a-8818-4940ae9e7175', 'volume_name': 'volume-fbf473d9-b790-4e6a-8818-4940ae9e7175', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87bd84-c534-4fa6-9f97-75b4d6571b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87bd84-c534-4fa6-9f97-75b4d6571b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb975d2f-ac3e-491a-b28a-8e2141717f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Volume fbf473d9-b790-4e6a-8818-4940ae9e7175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf473d9-b790-4e6a-8818-4940ae9e7175', 'volume_size': 1} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2104325412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf473d9-b790-4e6a-8818-4940ae9e7175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d85023653184b75b60bd9cd08cacb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:30Z,use_quota=True,user_id='0f2e5c5fcc2b493ebe04b9bb92626489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Creating volume fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:30 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:30 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 1073741824 Nov 05 08:39:30 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:30 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 1073741824" returned: 0 in 0.441s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:30 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:30 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:30 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb975d2f-ac3e-491a-b28a-8e2141717f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf473d9-b790-4e6a-8818-4940ae9e7175', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073d746c-fd50-4058-ad0f-3f031e000a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:30 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Volume volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 (fbf473d9-b790-4e6a-8818-4940ae9e7175): created successfully Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073d746c-fd50-4058-ad0f-3f031e000a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Flow 'volume_create_manager' (4469d2ab-0cb9-4909-9f82-291a94f9cb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-86fc4e12-5471-4671-b983-9c3807a8001b tempest-VolumeDependencyTests-1253571436 None] Created volume successfully. Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Creating offline snapshot 8fcd015e-df7c-4526-b1ca-7599ed92727a of volume fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe88de0-2176-4c05-bfb3-4bfc3824ecff]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:31 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:31 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:31 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:31 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a 1G Nov 05 08:39:31 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:32 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a 1G" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:32 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:32 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:32 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:32 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a is being set with open permissions: ugo+rw Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:32 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:32 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:32 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.233s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:32 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info Nov 05 08:39:32 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:32 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:32 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info is being set with open permissions: ugo+rw Nov 05 08:39:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:32 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info Nov 05 08:39:32 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:33 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.info" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:33 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f232e0a6-6a28-476b-9eaa-6722c366a277 tempest-VolumeDependencyTests-1253571436 None] Create snapshot completed successfully Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Flow 'volume_create_manager' (27f1c5b0-321e-460e-bef9-1f0f89634d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9647a1a7-51bc-4878-bd85-2c85e5d8ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9647a1a7-51bc-4878-bd85-2c85e5d8ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1439143411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a0a043-ae59-406c-9bf2-76a9a90be9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d85023653184b75b60bd9cd08cacb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fcd015e-df7c-4526-b1ca-7599ed92727a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:34Z,use_quota=True,user_id='0f2e5c5fcc2b493ebe04b9bb92626489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37f3784-6ca5-4f48-826c-394de24151a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37f3784-6ca5-4f48-826c-394de24151a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213d3cf6-ee88-42a0-8689-6973982443b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213d3cf6-ee88-42a0-8689-6973982443b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6a0a043-ae59-406c-9bf2-76a9a90be9c0', 'volume_name': 'volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0', 'volume_size': 1, 'snapshot_id': '8fcd015e-df7c-4526-b1ca-7599ed92727a'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec334ed2-2a81-4ee9-9298-3b882fd76df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec334ed2-2a81-4ee9-9298-3b882fd76df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f6a6f-1e55-4765-9e45-cc60900dc82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Volume b6a0a043-ae59-406c-9bf2-76a9a90be9c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0', 'volume_size': 1, 'snapshot_id': '8fcd015e-df7c-4526-b1ca-7599ed92727a'} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Creating volume b6a0a043-ae59-406c-9bf2-76a9a90be9c0 from snapshot 8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] snapshot: 8fcd015e-df7c-4526-b1ca-7599ed92727a, volume: b6a0a043-ae59-406c-9bf2-76a9a90be9c0, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c770325-5c07-42d8-bdf9-f5bb2a214896]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:34 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:34 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:34 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf473d9-b790-4e6a-8818-4940ae9e7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b65a5e-6514-411f-a8a9-afcd5eb748f9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:34 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:34 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:34 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:39:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:34 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 Nov 05 08:39:34 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:40 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" returned: 0 in 5.893s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:39:40 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Converted 1024.00 MB image at 173.73 MB/s Nov 05 08:39:40 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 is being set with open permissions: ugo+rw Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:40 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 Nov 05 08:39:40 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:40 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" returned: 0 in 0.234s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" released by "_copy_volume_from_snapshot" :: held 6.905s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" released by "_create_volume_from_snapshot" :: held 6.966s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.980s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f6a6f-1e55-4765-9e45-cc60900dc82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0', 'volume_size': 1, 'snapshot_id': '8fcd015e-df7c-4526-b1ca-7599ed92727a'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf80f4f4-fa8d-49e4-bddf-e48a9f0a091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Volume volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 (b6a0a043-ae59-406c-9bf2-76a9a90be9c0): created successfully Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf80f4f4-fa8d-49e4-bddf-e48a9f0a091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Flow 'volume_create_manager' (27f1c5b0-321e-460e-bef9-1f0f89634d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c8956e01-b91e-49f4-9ee7-0d7da5fd1ed1 tempest-VolumeDependencyTests-1253571436 None] Created volume successfully. Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-8fcd015e-df7c-4526-b1ca-7599ed92727a-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-8fcd015e-df7c-4526-b1ca-7599ed92727a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Deleting offline snapshot 8fcd015e-df7c-4526-b1ca-7599ed92727a of volume fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] snapshot_file for this snap is: volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14ea10-ad1f-4e1b-b83f-fa1ecbb21d77]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:41 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:41 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:41 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.342s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf473d9-b790-4e6a-8818-4940ae9e7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fc5c2-e8d5-4c59-bf49-e7c104226c02]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:42 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:42 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:42 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.508s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:42 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:42 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:42 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:42 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a Nov 05 08:39:42 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:43 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175.8fcd015e-df7c-4526-b1ca-7599ed92727a" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-8fcd015e-df7c-4526-b1ca-7599ed92727a" released by "_delete_snapshot" :: held 1.511s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" released by "delete_snapshot" :: held 1.534s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Created reservations ['d11f50f7-965e-433a-a7d6-51bcbe14a13a', '22fa8509-fcab-4151-9eba-63b2f02c8a34', '1357f62e-6842-4ac9-bf7c-37a9f300ac4e', 'faf729ed-fcd0-439b-8b92-2867b6022121'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:43 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Delete snapshot completed successfully. Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5a5f4f83-db14-4e0c-b56b-cafc6b7ceb5e tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-8fcd015e-df7c-4526-b1ca-7599ed92727a-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-fbf473d9-b790-4e6a-8818-4940ae9e7175-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-fbf473d9-b790-4e6a-8818-4940ae9e7175-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d7fea2-8a7c-412b-83c9-51628c278e35]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:43 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:43 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:44 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.352s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:44 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175 Nov 05 08:39:44 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:44 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fbf473d9-b790-4e6a-8818-4940ae9e7175" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-fbf473d9-b790-4e6a-8818-4940ae9e7175" released by "delete_volume" :: held 0.652s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Created reservations ['3e599ffe-9be6-4db8-9931-5de29498cdfd', '19944069-313b-4c3b-8fef-61531db9d1cc', '1e33b800-47b3-4d0e-b443-a9262c2e362c', '09b1a915-1db0-45ec-9643-e75436b52c1a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:44 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:44 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:44 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.230s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Deleted volume successfully. Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-417c2b53-3178-46cd-a04f-584828149847 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-fbf473d9-b790-4e6a-8818-4940ae9e7175-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-b6a0a043-ae59-406c-9bf2-76a9a90be9c0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-b6a0a043-ae59-406c-9bf2-76a9a90be9c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427f76a-bb95-4a28-b9fb-f735ec7ff217]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:45 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 Nov 05 08:39:45 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:45 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" returned: 0 in 0.341s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:45 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0 Nov 05 08:39:45 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:45 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" returned: 0 in 0.251s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-quobyte-b6a0a043-ae59-406c-9bf2-76a9a90be9c0" released by "delete_volume" :: held 0.631s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Created reservations ['7cef5732-79e3-45cb-bbbc-4eb4f6cb3760', '182b8a4d-27eb-46ef-b182-0b6fa3188dec', '2a60d301-9042-43b3-8093-0bd33d275244', '5ecc9b91-dd0e-42a6-a1ae-c375fa7bbfd0'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:45 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:45 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:45 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Deleted volume successfully. Nov 05 08:39:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-597df6e8-2f32-47dd-94ba-a7e5fb985db9 tempest-VolumeDependencyTests-1253571436 None] Lock "cinder-b6a0a043-ae59-406c-9bf2-76a9a90be9c0-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:48 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:48 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Flow 'volume_create_manager' (1c870883-011c-47bf-ad1c-0498b83a8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd658b67-92bf-4a46-a889-2c753b9b8317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd658b67-92bf-4a46-a889-2c753b9b8317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7661e17a-827b-4672-a4a9-b65b6cf0555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc62a5d6e9eb41caa077b97897744478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:49Z,use_quota=True,user_id='97550e70103d43cca1dfc31145f484c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb32f4-4690-433c-8932-7fdf955e45e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb32f4-4690-433c-8932-7fdf955e45e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327d7193-0f2a-466e-8187-6a78e7c9e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327d7193-0f2a-466e-8187-6a78e7c9e556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7661e17a-827b-4672-a4a9-b65b6cf0555c', 'volume_name': 'volume-7661e17a-827b-4672-a4a9-b65b6cf0555c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc96c5-c3c5-4cfc-b062-bd26a31ea4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc96c5-c3c5-4cfc-b062-bd26a31ea4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68824ffb-6842-4d38-a0a4-e37af6d8cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Volume 7661e17a-827b-4672-a4a9-b65b6cf0555c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7661e17a-827b-4672-a4a9-b65b6cf0555c', 'volume_size': 1} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7661e17a-827b-4672-a4a9-b65b6cf0555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc62a5d6e9eb41caa077b97897744478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:49Z,use_quota=True,user_id='97550e70103d43cca1dfc31145f484c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Creating volume 7661e17a-827b-4672-a4a9-b65b6cf0555c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:48 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:48 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:48 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c 1073741824 Nov 05 08:39:48 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:39:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:39:49 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c 1073741824" returned: 0 in 0.422s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:49 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c Nov 05 08:39:49 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:49 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68824ffb-6842-4d38-a0a4-e37af6d8cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7661e17a-827b-4672-a4a9-b65b6cf0555c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b6221f-27ec-4fa5-b1a8-015feb88c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:49 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Volume volume-7661e17a-827b-4672-a4a9-b65b6cf0555c (7661e17a-827b-4672-a4a9-b65b6cf0555c): created successfully Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b6221f-27ec-4fa5-b1a8-015feb88c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Flow 'volume_create_manager' (1c870883-011c-47bf-ad1c-0498b83a8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dab16e0a-dbb5-4f03-bb51-0d2b3cb6a8f0 tempest-CinderUnicodeTest-1360065853 None] Created volume successfully. Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Flow 'volume_create_manager' (4df5d906-3177-401d-ad54-4a941d0a643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73dfee66-8a53-44ac-988d-58e68ba9ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73dfee66-8a53-44ac-988d-58e68ba9ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-863536605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c6497d-af0f-410b-9028-ca1af1fee06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc62a5d6e9eb41caa077b97897744478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:50Z,use_quota=True,user_id='97550e70103d43cca1dfc31145f484c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac7eb65-396f-4500-ad0f-0bf84915e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac7eb65-396f-4500-ad0f-0bf84915e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77558a45-c3ac-4bec-b492-3b3153339c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77558a45-c3ac-4bec-b492-3b3153339c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c6497d-af0f-410b-9028-ca1af1fee06b', 'volume_name': 'volume-a8c6497d-af0f-410b-9028-ca1af1fee06b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3ec3d2-f87f-4038-a2c4-d0b74947d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3ec3d2-f87f-4038-a2c4-d0b74947d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c00366-21cc-49ff-9766-9f8c50b35903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Volume a8c6497d-af0f-410b-9028-ca1af1fee06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c6497d-af0f-410b-9028-ca1af1fee06b', 'volume_size': 1} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-863536605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c6497d-af0f-410b-9028-ca1af1fee06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc62a5d6e9eb41caa077b97897744478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:50Z,use_quota=True,user_id='97550e70103d43cca1dfc31145f484c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Creating volume a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:50 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:50 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b 1073741824 Nov 05 08:39:50 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:50 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b 1073741824" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:50 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b Nov 05 08:39:50 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:50 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c00366-21cc-49ff-9766-9f8c50b35903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c6497d-af0f-410b-9028-ca1af1fee06b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bb4854-5090-4dd5-ab60-99ad5b4815b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Volume volume-a8c6497d-af0f-410b-9028-ca1af1fee06b (a8c6497d-af0f-410b-9028-ca1af1fee06b): created successfully Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bb4854-5090-4dd5-ab60-99ad5b4815b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Flow 'volume_create_manager' (4df5d906-3177-401d-ad54-4a941d0a643d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-30eda947-97ef-4343-ad0a-ded3864b25f1 tempest-CinderUnicodeTest-1360065853 None] Created volume successfully. Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Creating offline snapshot 366d3522-9066-42f2-98c6-568409fe6d18 of volume a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c270bbd-4f98-4a78-af32-bfaf860eeab2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:51 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b Nov 05 08:39:51 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:51 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:51 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 1G Nov 05 08:39:51 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:52 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 1G" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c6497d-af0f-410b-9028-ca1af1fee06b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:52 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c6497d-af0f-410b-9028-ca1af1fee06b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 Nov 05 08:39:52 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:52 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c6497d-af0f-410b-9028-ca1af1fee06b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18" returned: 0 in 0.296s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:52 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 is being set with open permissions: ugo+rw Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:52 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 Nov 05 08:39:52 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:52 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:52 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info Nov 05 08:39:52 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:53 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info" returned: 0 in 0.262s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:53 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info is being set with open permissions: ugo+rw Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:53 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info Nov 05 08:39:53 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:53 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.info" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cdc4d48e-6b08-420e-852f-2ff78c6039e4 tempest-CinderUnicodeTest-1360065853 None] Create snapshot completed successfully Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-366d3522-9066-42f2-98c6-568409fe6d18-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-366d3522-9066-42f2-98c6-568409fe6d18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-quobyte-366d3522-9066-42f2-98c6-568409fe6d18" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-366d3522-9066-42f2-98c6-568409fe6d18" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Deleting offline snapshot 366d3522-9066-42f2-98c6-568409fe6d18 of volume a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] snapshot_file for this snap is: volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f984618-f22a-4b28-9a0d-76a6577decaa]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:53 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 Nov 05 08:39:53 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:53 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c6497d-af0f-410b-9028-ca1af1fee06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[318781d1-74bd-459e-b3b6-76b09ec30baf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:54 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b Nov 05 08:39:54 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:54 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b" returned: 0 in 0.359s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:54 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 Nov 05 08:39:54 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:54 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:54 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18 Nov 05 08:39:54 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:54 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b.366d3522-9066-42f2-98c6-568409fe6d18" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-366d3522-9066-42f2-98c6-568409fe6d18" released by "_delete_snapshot" :: held 1.397s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" released by "delete_snapshot" :: held 1.416s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Created reservations ['73f38259-52c9-4b1f-bd8a-4116b9aee70e', 'ffc959c9-f4f6-412b-af3d-c31d03efdac8', 'aa4fbdb7-81ac-456a-93c4-5fc1eecc8607', '66772871-ac42-47e8-8d16-5e0101b115c5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Delete snapshot completed successfully. Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9b2d2dcf-7b84-4931-aa0a-2267aca4843f tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-366d3522-9066-42f2-98c6-568409fe6d18-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-a8c6497d-af0f-410b-9028-ca1af1fee06b-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-a8c6497d-af0f-410b-9028-ca1af1fee06b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e45f45-2d8e-42ad-b46b-ade3b8d1acef]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:55 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b Nov 05 08:39:55 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:56 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:56 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b Nov 05 08:39:56 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:56 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-a8c6497d-af0f-410b-9028-ca1af1fee06b" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-a8c6497d-af0f-410b-9028-ca1af1fee06b" released by "delete_volume" :: held 0.673s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Created reservations ['962960da-d13a-4262-8d66-4a08b816b79e', '60f1341a-fb68-4f1a-92f6-a2d36f311687', '9cbd688d-4a39-41b2-b1fb-b2e758798115', 'f9cef71c-c86c-4d4d-a038-855b8ddca4f8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:56 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:56 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:56 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Deleted volume successfully. Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a45e1295-a2f8-4b90-9f2c-0a385bdffa90 tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-a8c6497d-af0f-410b-9028-ca1af1fee06b-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-7661e17a-827b-4672-a4a9-b65b6cf0555c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-7661e17a-827b-4672-a4a9-b65b6cf0555c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "cinder-quobyte-7661e17a-827b-4672-a4a9-b65b6cf0555c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-7661e17a-827b-4672-a4a9-b65b6cf0555c" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1701b0-dd1b-4ac6-9e90-ea9bbfd33d45]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:57 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c Nov 05 08:39:57 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:57 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:57 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c Nov 05 08:39:57 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:57 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7661e17a-827b-4672-a4a9-b65b6cf0555c" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-quobyte-7661e17a-827b-4672-a4a9-b65b6cf0555c" released by "delete_volume" :: held 0.642s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Created reservations ['0e2cad92-1303-48f4-aafc-c6b299a31fce', 'b4bcf1fa-5b83-477a-8c8f-c5f64677ba24', '50cec86f-44ab-4e00-b0c4-9ebb361b5e72', '88956b30-58e4-426a-8339-c31f3de27176'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:57 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:39:57 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:57 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Deleted volume successfully. Nov 05 08:39:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a35db0b5-de67-42d7-ab94-6335618e8a3c tempest-CinderUnicodeTest-1360065853 None] Lock "cinder-7661e17a-827b-4672-a4a9-b65b6cf0555c-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (7ab12df4-603e-4894-800b-37dec8e89536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab284c85-41cd-44e4-b104-e7b7c81d72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab284c85-41cd-44e4-b104-e7b7c81d72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281917930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469a324a-98cd-4558-a7eb-c4460add22a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:05Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c515d8-c08c-4027-a1fe-fbadbcb09e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c515d8-c08c-4027-a1fe-fbadbcb09e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb92fb-7491-4fef-98d9-2a4d4d0a4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb92fb-7491-4fef-98d9-2a4d4d0a4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469a324a-98cd-4558-a7eb-c4460add22a6', 'volume_name': 'volume-469a324a-98cd-4558-a7eb-c4460add22a6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1fe0d8-a56f-45a7-bb8f-e1bcdcccfb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1fe0d8-a56f-45a7-bb8f-e1bcdcccfb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5882823-5bdc-47de-8fd1-7b9d62599f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Volume 469a324a-98cd-4558-a7eb-c4460add22a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469a324a-98cd-4558-a7eb-c4460add22a6', 'volume_size': 1} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281917930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469a324a-98cd-4558-a7eb-c4460add22a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:05Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Creating volume 469a324a-98cd-4558-a7eb-c4460add22a6 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:05 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:40:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:05 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 1073741824 Nov 05 08:40:05 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:06 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 1073741824" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:06 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 Nov 05 08:40:06 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:06 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5882823-5bdc-47de-8fd1-7b9d62599f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469a324a-98cd-4558-a7eb-c4460add22a6', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1be46e7-e056-4429-941a-6365a436cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Volume volume-469a324a-98cd-4558-a7eb-c4460add22a6 (469a324a-98cd-4558-a7eb-c4460add22a6): created successfully Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1be46e7-e056-4429-941a-6365a436cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (7ab12df4-603e-4894-800b-37dec8e89536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dac60a7f-7722-4d43-abd6-2d353e926a3b tempest-ProjectReaderTests-1411085426 None] Created volume successfully. Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-469a324a-98cd-4558-a7eb-c4460add22a6-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "cinder-469a324a-98cd-4558-a7eb-c4460add22a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-quobyte-469a324a-98cd-4558-a7eb-c4460add22a6" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-469a324a-98cd-4558-a7eb-c4460add22a6" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a6865-8e01-440e-8a62-dbb8375ca914]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:06 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 Nov 05 08:40:06 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:07 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:07 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6 Nov 05 08:40:07 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:07 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-469a324a-98cd-4558-a7eb-c4460add22a6" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-469a324a-98cd-4558-a7eb-c4460add22a6" released by "delete_volume" :: held 0.627s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Created reservations ['6020d86a-a83f-4d6a-9cdc-598e884a502d', 'c8643061-b911-4b99-a591-74214ae688f8', '5ee77f95-30c6-4ae9-8db9-b1f953e1104d', '4e0c15c7-bd5f-4585-8612-365bbb44cfb2'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:07 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:07 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:07 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Deleted volume successfully. Nov 05 08:40:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-ca45694e-8bcf-4538-bc30-e786d1c4689f tempest-ProjectReaderTests-1411085426 None] Lock "cinder-469a324a-98cd-4558-a7eb-c4460add22a6-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (50ae6c10-5aba-4948-a193-52c32b1e9756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d1db42-d48f-4b92-bdbe-bac0c58de776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d1db42-d48f-4b92-bdbe-bac0c58de776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815954457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dec9e7-0899-4232-8872-e69cd1f301dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:08Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94737632-957c-462b-a90c-674a6230e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94737632-957c-462b-a90c-674a6230e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857bfa03-6d64-4ee6-ba27-2d9cca36284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857bfa03-6d64-4ee6-ba27-2d9cca36284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dec9e7-0899-4232-8872-e69cd1f301dd', 'volume_name': 'volume-53dec9e7-0899-4232-8872-e69cd1f301dd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00141f0-c56a-46d3-9551-e928800e07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00141f0-c56a-46d3-9551-e928800e07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cefe97-e83b-4905-bea7-efea6298a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:08 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Volume 53dec9e7-0899-4232-8872-e69cd1f301dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dec9e7-0899-4232-8872-e69cd1f301dd', 'volume_size': 1} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815954457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dec9e7-0899-4232-8872-e69cd1f301dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:08Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Creating volume 53dec9e7-0899-4232-8872-e69cd1f301dd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:08 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:08 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd 1073741824 Nov 05 08:40:08 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:08 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd 1073741824" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:08 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd Nov 05 08:40:08 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:08 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:40:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cefe97-e83b-4905-bea7-efea6298a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dec9e7-0899-4232-8872-e69cd1f301dd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c26f64-8184-414f-af86-2cd7c0ab032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:09 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Volume volume-53dec9e7-0899-4232-8872-e69cd1f301dd (53dec9e7-0899-4232-8872-e69cd1f301dd): created successfully Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c26f64-8184-414f-af86-2cd7c0ab032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (50ae6c10-5aba-4948-a193-52c32b1e9756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:09 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-337ae7ea-b088-45a3-b134-cbc1df7a8195 tempest-ProjectReaderTests-1411085426 None] Created volume successfully. Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-53dec9e7-0899-4232-8872-e69cd1f301dd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-53dec9e7-0899-4232-8872-e69cd1f301dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-quobyte-53dec9e7-0899-4232-8872-e69cd1f301dd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-53dec9e7-0899-4232-8872-e69cd1f301dd" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[749bb24b-d056-4ac8-80d0-022ace51853d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:09 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd Nov 05 08:40:09 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:09 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd" returned: 0 in 0.341s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:09 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd Nov 05 08:40:09 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:09 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-53dec9e7-0899-4232-8872-e69cd1f301dd" returned: 0 in 0.251s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-53dec9e7-0899-4232-8872-e69cd1f301dd" released by "delete_volume" :: held 0.634s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Created reservations ['4e141b07-664a-4692-a195-a259cd141cf8', 'faae40dd-e1fe-443b-91ce-fd70a004ed44', '5f20661e-bd27-47e2-88ab-1d574eff34d9', 'e5235178-dc03-467e-b2d6-7ddc9892f448'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:10 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:10 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:10 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Deleted volume successfully. Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-2ca5b61d-bc7f-4f9d-b9fb-3b9c21bd1ca6 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-53dec9e7-0899-4232-8872-e69cd1f301dd-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (eebe75e8-239a-470f-a8d3-7f3aade10f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f44ca1d-6e3e-41cd-a752-fe5a3f4d3434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f44ca1d-6e3e-41cd-a752-fe5a3f4d3434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992041578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e357a8b-ee84-465d-9c3c-aa9c40b5e29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:11Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5c6c4d-6a1f-4171-a496-5e4b5c851972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5c6c4d-6a1f-4171-a496-5e4b5c851972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bc891d-5582-45ff-bf0d-863f83e4d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bc891d-5582-45ff-bf0d-863f83e4d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e357a8b-ee84-465d-9c3c-aa9c40b5e29d', 'volume_name': 'volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bdf6d8-57a6-4a53-bacc-f1f6e00a016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bdf6d8-57a6-4a53-bacc-f1f6e00a016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d2dd66-e044-466e-83f5-10fae80fc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:10 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Volume 6e357a8b-ee84-465d-9c3c-aa9c40b5e29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d', 'volume_size': 1} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992041578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e357a8b-ee84-465d-9c3c-aa9c40b5e29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:11Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Creating volume 6e357a8b-ee84-465d-9c3c-aa9c40b5e29d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:10 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:40:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:10 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d 1073741824 Nov 05 08:40:10 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:11 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d 1073741824" returned: 0 in 0.411s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:11 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d Nov 05 08:40:11 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:11 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d2dd66-e044-466e-83f5-10fae80fc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f19bf8-5158-4429-97e1-9b725c255caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:11 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Volume volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d (6e357a8b-ee84-465d-9c3c-aa9c40b5e29d): created successfully Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f19bf8-5158-4429-97e1-9b725c255caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (eebe75e8-239a-470f-a8d3-7f3aade10f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7b587bfd-66c7-4b3e-86da-29a04d46b74e tempest-ProjectReaderTests-1411085426 None] Created volume successfully. Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-quobyte-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce60dd1-ab1b-4a0d-8caf-61f7cd14c351]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:12 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d Nov 05 08:40:12 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:12 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:12 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d Nov 05 08:40:12 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:12 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d" released by "delete_volume" :: held 0.650s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Created reservations ['6f3b40e7-f386-4d08-b3fe-d6d77adc391b', '7232a740-fb82-4b29-aafc-54ee58e83ba6', '04565f59-a3a8-46d1-bedb-5c387b33b256', 'cb923e26-af0c-4976-99c2-2f14f294e266'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:12 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:12 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:13 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Deleted volume successfully. Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-db33f6e7-ca9a-4257-9a7f-faade9844925 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-6e357a8b-ee84-465d-9c3c-aa9c40b5e29d-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (f84ea1c3-078f-4b84-b6e0-61e431950450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45ebb0f-3043-4530-a21a-5a997dab591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45ebb0f-3043-4530-a21a-5a997dab591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145989978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657fea0-2c8e-43e5-b356-6c4cc9e864f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:13Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c93fa6b-74e7-4006-babb-1afd13c8cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c93fa6b-74e7-4006-babb-1afd13c8cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6479c7df-c6f9-49b2-a842-063ad0c3bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6479c7df-c6f9-49b2-a842-063ad0c3bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0657fea0-2c8e-43e5-b356-6c4cc9e864f5', 'volume_name': 'volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e35b9a-a922-4750-96ec-4f1b2dd2fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e35b9a-a922-4750-96ec-4f1b2dd2fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1eb050-eae3-437a-888f-216618f0c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:13 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Volume 0657fea0-2c8e-43e5-b356-6c4cc9e864f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5', 'volume_size': 1} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145989978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657fea0-2c8e-43e5-b356-6c4cc9e864f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2793013713804332a0f257a237529bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:13Z,use_quota=True,user_id='844aae4df4ae451e8a3057af1a58358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Creating volume 0657fea0-2c8e-43e5-b356-6c4cc9e864f5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:13 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:13 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 1073741824 Nov 05 08:40:13 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:13 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 1073741824" returned: 0 in 0.404s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:14 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 Nov 05 08:40:14 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:14 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" returned: 0 in 0.236s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1eb050-eae3-437a-888f-216618f0c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e143f223-7cf2-4f6d-b43b-81a4bdf2f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:14 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Volume volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 (0657fea0-2c8e-43e5-b356-6c4cc9e864f5): created successfully Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e143f223-7cf2-4f6d-b43b-81a4bdf2f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Flow 'volume_create_manager' (f84ea1c3-078f-4b84-b6e0-61e431950450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6a669624-bde6-41e1-9f6f-2daf4e5e432b tempest-ProjectReaderTests-1411085426 None] Created volume successfully. Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-0657fea0-2c8e-43e5-b356-6c4cc9e864f5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-0657fea0-2c8e-43e5-b356-6c4cc9e864f5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "cinder-quobyte-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a77a87-3833-4163-980c-52448d68f27f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:14 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 Nov 05 08:40:14 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:14 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" returned: 0 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:15 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5 Nov 05 08:40:15 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:15 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-quobyte-0657fea0-2c8e-43e5-b356-6c4cc9e864f5" released by "delete_volume" :: held 0.655s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=150,cinder:SELECT=116,cinder:DELETE=13,cinder:INSERT=32 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Created reservations ['763c6e4e-b6c6-4bbb-a6b5-d9f44b5bccce', 'c1eab587-4ef1-486f-9970-6cd08956c3bb', 'c558d68e-5d3d-49d3-9267-43bcbbf949a1', '0a1adbb3-9616-4ba8-a967-d456281ea3c6'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:15 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:15 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:15 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Deleted volume successfully. Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=103,cinder:UPDATE=155,cinder:INSERT=41,cinder:DELETE=15 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-94306dd7-3f96-49da-82c8-5ee2cd0433a2 tempest-ProjectReaderTests-1411085426 None] Lock "cinder-0657fea0-2c8e-43e5-b356-6c4cc9e864f5-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:INSERT=2,cinder:UPDATE=9,cinder:SELECT=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=1 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:38 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:38 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Flow 'volume_create_manager' (cc2b1a5d-fcb4-40ce-ac74-9cd7d3e43424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed1ee7c-fee5-4c38-8a62-089387509326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed1ee7c-fee5-4c38-8a62-089387509326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1569253919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247625de-ab60-4842-adf8-e2cde66f913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d1618282ba46e29e17a0448a595698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:39Z,use_quota=True,user_id='18da4050d7e241068c761c2698e61ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab1872f-0ad6-4b1f-9b95-458dcef81735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab1872f-0ad6-4b1f-9b95-458dcef81735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472a300-b8f4-44c0-aa3a-4ec1a03bc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472a300-b8f4-44c0-aa3a-4ec1a03bc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247625de-ab60-4842-adf8-e2cde66f913f', 'volume_name': 'volume-247625de-ab60-4842-adf8-e2cde66f913f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd84f2cc-4601-4c69-aea1-31ae7fb4b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd84f2cc-4601-4c69-aea1-31ae7fb4b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8bcfcd-3909-481c-903a-65486f76cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Volume 247625de-ab60-4842-adf8-e2cde66f913f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247625de-ab60-4842-adf8-e2cde66f913f', 'volume_size': 1} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1569253919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247625de-ab60-4842-adf8-e2cde66f913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d1618282ba46e29e17a0448a595698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:39Z,use_quota=True,user_id='18da4050d7e241068c761c2698e61ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Creating volume 247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:39 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:39 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f 1073741824 Nov 05 08:40:39 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:39 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f 1073741824" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:39 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:39 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:39 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.237s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8bcfcd-3909-481c-903a-65486f76cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247625de-ab60-4842-adf8-e2cde66f913f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c533b5b-ff6f-43c5-8b6d-8d9dc171fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Volume volume-247625de-ab60-4842-adf8-e2cde66f913f (247625de-ab60-4842-adf8-e2cde66f913f): created successfully Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c533b5b-ff6f-43c5-8b6d-8d9dc171fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Flow 'volume_create_manager' (cc2b1a5d-fcb4-40ce-ac74-9cd7d3e43424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-22eaa53b-44b8-444c-bae7-035daef9e1cc tempest-SnapshotDependencyTests-661960050 None] Created volume successfully. Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Creating offline snapshot 8881736d-4755-4b20-ac36-9e2ab46d2656 of volume 247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510eea5-cbaa-4412-927d-4aba0294c558]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:40 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:40 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:40 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.360s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:40 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 1G Nov 05 08:40:40 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:40 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 1G" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247625de-ab60-4842-adf8-e2cde66f913f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:41 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247625de-ab60-4842-adf8-e2cde66f913f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:41 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:41 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247625de-ab60-4842-adf8-e2cde66f913f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:41 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 is being set with open permissions: ugo+rw Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:41 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:41 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:41 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.252s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:41 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info Nov 05 08:40:41 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:41 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:41 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info is being set with open permissions: ugo+rw Nov 05 08:40:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:41 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info Nov 05 08:40:41 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:42 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.info" returned: 0 in 0.237s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3b3f37f2-46f1-4b56-a61b-ae538484c22d tempest-SnapshotDependencyTests-661960050 None] Create snapshot completed successfully Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Flow 'volume_create_manager' (459f9f2a-d3ab-4585-b334-0d6be8f84fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4101944-0946-44eb-8e16-103058765134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4101944-0946-44eb-8e16-103058765134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ae5153-5d82-4fb0-a75d-432434082ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d1618282ba46e29e17a0448a595698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8881736d-4755-4b20-ac36-9e2ab46d2656,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:43Z,use_quota=True,user_id='18da4050d7e241068c761c2698e61ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b119db4e-501d-427e-bc7f-caa5116cd7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b119db4e-501d-427e-bc7f-caa5116cd7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9fafa-486e-4191-b962-2008b9a5573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9fafa-486e-4191-b962-2008b9a5573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0ae5153-5d82-4fb0-a75d-432434082ac9', 'volume_name': 'volume-d0ae5153-5d82-4fb0-a75d-432434082ac9', 'volume_size': 1, 'snapshot_id': '8881736d-4755-4b20-ac36-9e2ab46d2656'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f787d-eae7-45ee-ae4b-e16846b5c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f787d-eae7-45ee-ae4b-e16846b5c155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa48990-2f78-4b7d-a58e-3f371dca24f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Volume d0ae5153-5d82-4fb0-a75d-432434082ac9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0ae5153-5d82-4fb0-a75d-432434082ac9', 'volume_size': 1, 'snapshot_id': '8881736d-4755-4b20-ac36-9e2ab46d2656'} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656-d0ae5153-5d82-4fb0-a75d-432434082ac9" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656-d0ae5153-5d82-4fb0-a75d-432434082ac9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Creating volume d0ae5153-5d82-4fb0-a75d-432434082ac9 from snapshot 8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] snapshot: 8881736d-4755-4b20-ac36-9e2ab46d2656, volume: d0ae5153-5d82-4fb0-a75d-432434082ac9, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6771a7-3a59-4563-912c-b92a7d3b1522]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:43 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:43 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:43 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.361s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247625de-ab60-4842-adf8-e2cde66f913f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[730fe449-4bcc-4be0-a39e-d5b145541129]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:43 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:43 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:44 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.360s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:40:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:40:44 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:40:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:44 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 Nov 05 08:40:44 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:48 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:48 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:49 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.453s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:49 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:40:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:40:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:40:50 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9" returned: 0 in 6.003s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:40:50 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Converted 1024.00 MB image at 170.56 MB/s Nov 05 08:40:50 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 is being set with open permissions: ugo+rw Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:50 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 Nov 05 08:40:50 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:50 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9" returned: 0 in 0.235s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" released by "_copy_volume_from_snapshot" :: held 7.038s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656-d0ae5153-5d82-4fb0-a75d-432434082ac9" released by "_create_volume_from_snapshot" :: held 7.105s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.120s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa48990-2f78-4b7d-a58e-3f371dca24f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ae5153-5d82-4fb0-a75d-432434082ac9', 'volume_size': 1, 'snapshot_id': '8881736d-4755-4b20-ac36-9e2ab46d2656'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c9cb77-7bdf-4a59-b5d8-160ea99d2967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Volume volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 (d0ae5153-5d82-4fb0-a75d-432434082ac9): created successfully Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c9cb77-7bdf-4a59-b5d8-160ea99d2967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Flow 'volume_create_manager' (459f9f2a-d3ab-4585-b334-0d6be8f84fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c223e1d2-c0d9-4201-8687-4e7c7faec46c tempest-SnapshotDependencyTests-661960050 None] Created volume successfully. Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-8881736d-4755-4b20-ac36-9e2ab46d2656-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-8881736d-4755-4b20-ac36-9e2ab46d2656-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Deleting offline snapshot 8881736d-4755-4b20-ac36-9e2ab46d2656 of volume 247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] snapshot_file for this snap is: volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[96305cb5-eff3-4967-8709-1df05d3b7379]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:50 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:50 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:51 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247625de-ab60-4842-adf8-e2cde66f913f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a8e60a-e1c1-4ac6-84ed-327a3b6f0788]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:51 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:51 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:51 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.545s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:51 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:51 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:52 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.334s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:52 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656 Nov 05 08:40:52 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:52 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f.8881736d-4755-4b20-ac36-9e2ab46d2656" returned: 0 in 0.269s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-8881736d-4755-4b20-ac36-9e2ab46d2656" released by "_delete_snapshot" :: held 1.621s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" released by "delete_snapshot" :: held 1.643s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Created reservations ['a46222e6-a782-4471-a5af-0ccc6fceff95', 'd81baab9-7f84-49eb-9c04-e11b9878cdf7', 'ac0003df-fe00-4839-97e4-dc854eabaa68', '9f2d4984-c5ae-4ebe-805f-b126ee4408ce'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Delete snapshot completed successfully. Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-088191ad-0403-4248-b1ce-f70429e99e04 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-8881736d-4755-4b20-ac36-9e2ab46d2656-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-247625de-ab60-4842-adf8-e2cde66f913f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-247625de-ab60-4842-adf8-e2cde66f913f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[962177ed-114d-4d48-b0c2-e3668858b754]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:53 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:53 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:53 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.380s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:53 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f Nov 05 08:40:53 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:53 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-247625de-ab60-4842-adf8-e2cde66f913f" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-247625de-ab60-4842-adf8-e2cde66f913f" released by "delete_volume" :: held 0.706s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Created reservations ['13faf483-34ac-477c-a55b-5ef0ab82c931', '6c83c57a-4fa7-4c79-9317-6d947f6cd7e9', 'f86dc14c-48e3-40a0-a81f-77c5784181b6', 'a811d6a5-9a57-4a24-b1e1-885de6000da8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:53 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:53 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:54 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.247s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Deleted volume successfully. Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-d0ae5153-5d82-4fb0-a75d-432434082ac9-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bffe4dff-e9db-468c-af73-0b0c696cb1a6 tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-247625de-ab60-4842-adf8-e2cde66f913f-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-d0ae5153-5d82-4fb0-a75d-432434082ac9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214ce69-17a9-4dd6-9b3c-f25917b7c3a8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:54 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 Nov 05 08:40:54 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:54 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:54 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9 Nov 05 08:40:54 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:54 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d0ae5153-5d82-4fb0-a75d-432434082ac9" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-quobyte-d0ae5153-5d82-4fb0-a75d-432434082ac9" released by "delete_volume" :: held 0.644s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Created reservations ['08ab6501-86ff-4a39-b426-e4f0290ac4bf', 'fda74df2-869c-49b2-bef7-00ecab37a097', 'a40e9ce6-09a0-4655-9f98-30387558ea1e', '33566438-524b-4d04-b294-b743dd09987b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:54 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:40:54 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:55 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.252s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:55 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Deleted volume successfully. Nov 05 08:40:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-446a2fc7-fa3f-4cdd-a259-4dc01abfc55d tempest-SnapshotDependencyTests-661960050 None] Lock "cinder-d0ae5153-5d82-4fb0-a75d-432434082ac9-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:04 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:05 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=30,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (d0de8897-142e-48f1-8b35-05812606ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e272088-6da7-43f2-8990-a9ab30d14802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e272088-6da7-43f2-8990-a9ab30d14802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1670967974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ad5358-a039-4ef7-8b97-8ac5a860a464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:16Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f667efe0-e3ea-4d27-92b8-059e20cd407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f667efe0-e3ea-4d27-92b8-059e20cd407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0553904b-5e1e-49b3-b7e3-f75147cecee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0553904b-5e1e-49b3-b7e3-f75147cecee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ad5358-a039-4ef7-8b97-8ac5a860a464', 'volume_name': 'volume-81ad5358-a039-4ef7-8b97-8ac5a860a464', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42a2da1-d854-4140-a87d-f97412d121ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42a2da1-d854-4140-a87d-f97412d121ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774968a8-eeed-4cee-b3be-e1840935248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Volume 81ad5358-a039-4ef7-8b97-8ac5a860a464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ad5358-a039-4ef7-8b97-8ac5a860a464', 'volume_size': 1} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1670967974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ad5358-a039-4ef7-8b97-8ac5a860a464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:16Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Creating volume 81ad5358-a039-4ef7-8b97-8ac5a860a464 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:15 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:16 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 1073741824 Nov 05 08:41:16 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (7a8a2b96-394e-461a-a54b-ee03f1f9ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216d447b-2d3b-47dd-bd8d-2dfa4aec5b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216d447b-2d3b-47dd-bd8d-2dfa4aec5b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2126875089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a7b59d-161a-4e51-b304-d40e1c9ad6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:16Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95124084-36cf-4ce6-bd1a-749d7acbd810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95124084-36cf-4ce6-bd1a-749d7acbd810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7855338a-7783-4026-92e8-80b2a489d0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7855338a-7783-4026-92e8-80b2a489d0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a7b59d-161a-4e51-b304-d40e1c9ad6f0', 'volume_name': 'volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83093104-78c6-48a3-a3b9-d77c5366d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83093104-78c6-48a3-a3b9-d77c5366d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c330a93c-e79e-42f3-8122-96bb362fb7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:16 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Volume b2a7b59d-161a-4e51-b304-d40e1c9ad6f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0', 'volume_size': 1} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:16 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 1073741824" returned: 0 in 0.703s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:16 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 Nov 05 08:41:16 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (f7eb1fb4-239e-46cf-b37a-501ba194fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af539a2c-39ae-4cf4-bfc2-38b583732d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af539a2c-39ae-4cf4-bfc2-38b583732d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850296819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020bd4e6-83d4-4213-8b10-f8650f0039bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:17Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feeaca8-224c-4420-b34a-32b6eaafba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feeaca8-224c-4420-b34a-32b6eaafba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90f6696-383b-4747-bbd1-2a96acaa03be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90f6696-383b-4747-bbd1-2a96acaa03be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020bd4e6-83d4-4213-8b10-f8650f0039bd', 'volume_name': 'volume-020bd4e6-83d4-4213-8b10-f8650f0039bd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab091a72-861d-429e-a350-4e753d7e319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab091a72-861d-429e-a350-4e753d7e319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc0008-264e-48f5-a649-ff60bbd46978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Volume 020bd4e6-83d4-4213-8b10-f8650f0039bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020bd4e6-83d4-4213-8b10-f8650f0039bd', 'volume_size': 1} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:17 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464" returned: 0 in 0.524s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2126875089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a7b59d-161a-4e51-b304-d40e1c9ad6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:16Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Creating volume b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:17 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774968a8-eeed-4cee-b3be-e1840935248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ad5358-a039-4ef7-8b97-8ac5a860a464', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 1073741824 Nov 05 08:41:17 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5e188-2a84-43a9-b924-648b6e42e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:17 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Volume volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 (81ad5358-a039-4ef7-8b97-8ac5a860a464): created successfully Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5e188-2a84-43a9-b924-648b6e42e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (d0de8897-142e-48f1-8b35-05812606ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ac82508b-db3a-4fd1-b12b-c1f33c1f558f tempest-CreateVolumesFromImageTest-1971085529 None] Created volume successfully. Nov 05 08:41:17 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 1073741824" returned: 0 in 0.678s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:18 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 Nov 05 08:41:18 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (2f64f86a-cb26-4ab0-b582-191365360fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21631dbb-078b-41c7-8d6a-611a565db838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21631dbb-078b-41c7-8d6a-611a565db838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111994137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a726f5a-d928-4dee-97bc-70ddc7a6739e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:18Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d33f26-3341-49be-9b6a-80d871880ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d33f26-3341-49be-9b6a-80d871880ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d51872a-3437-4a92-a377-16b09ad56d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d51872a-3437-4a92-a377-16b09ad56d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a726f5a-d928-4dee-97bc-70ddc7a6739e', 'volume_name': 'volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66601d1-7fd9-495e-a69d-374f02ce2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66601d1-7fd9-495e-a69d-374f02ce2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5752f6c8-48c5-4fdb-bcec-9d0fc2b3d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Volume 7a726f5a-d928-4dee-97bc-70ddc7a6739e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e', 'volume_size': 1} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (36f610f7-7325-47bb-9e13-d849a745df26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02d6874-f8cb-43f4-b410-cc44301b8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02d6874-f8cb-43f4-b410-cc44301b8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1587323445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca01e7a3-0be9-4298-8090-ec6d30c315fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:18Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab3384d-a919-48bb-8cd5-2cda23f4a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab3384d-a919-48bb-8cd5-2cda23f4a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8adf6d-6578-4333-b004-93937ae2ea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8adf6d-6578-4333-b004-93937ae2ea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca01e7a3-0be9-4298-8090-ec6d30c315fc', 'volume_name': 'volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b30e720-cfcf-447c-b8ed-d8af51a32d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b30e720-cfcf-447c-b8ed-d8af51a32d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777eab8d-d774-4e1c-82e5-e2c3ebc00b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Volume ca01e7a3-0be9-4298-8090-ec6d30c315fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc', 'volume_size': 1} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" returned: 0 in 0.325s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850296819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020bd4e6-83d4-4213-8b10-f8650f0039bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:17Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Creating volume 020bd4e6-83d4-4213-8b10-f8650f0039bd {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:18 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c330a93c-e79e-42f3-8122-96bb362fb7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247e9ea6-2984-4b92-8f94-b96dfeea1d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:18 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd 1073741824 Nov 05 08:41:18 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:18 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Volume volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 (b2a7b59d-161a-4e51-b304-d40e1c9ad6f0): created successfully Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247e9ea6-2984-4b92-8f94-b96dfeea1d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (7a8a2b96-394e-461a-a54b-ee03f1f9ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c46d050c-430b-4729-9139-e0a00d93eb8c tempest-CreateVolumesFromImageTest-1971085529 None] Created volume successfully. Nov 05 08:41:18 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd 1073741824" returned: 0 in 0.565s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:19 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd Nov 05 08:41:19 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:19 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111994137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a726f5a-d928-4dee-97bc-70ddc7a6739e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:18Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Creating volume 7a726f5a-d928-4dee-97bc-70ddc7a6739e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:19 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc0008-264e-48f5-a649-ff60bbd46978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020bd4e6-83d4-4213-8b10-f8650f0039bd', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:19 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e 1073741824 Nov 05 08:41:19 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce0fcb9-0b64-413d-8057-2513b7e0ae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:19 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Volume volume-020bd4e6-83d4-4213-8b10-f8650f0039bd (020bd4e6-83d4-4213-8b10-f8650f0039bd): created successfully Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce0fcb9-0b64-413d-8057-2513b7e0ae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (f7eb1fb4-239e-46cf-b37a-501ba194fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:19 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a3725bad-d17f-4c61-9064-58e9880e22cd tempest-CreateVolumesFromImageTest-1971085529 None] Created volume successfully. Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Flow 'volume_create_manager' (02a0fcc6-35e9-4b68-aff8-d9a3a061c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f020cd14-dff8-47f9-a793-73ef14559306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f020cd14-dff8-47f9-a793-73ef14559306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c146b3d3c864cebb186aa6e209eaa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:20Z,use_quota=True,user_id='fb31075a51af4511b0c4dacfef812926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72238639-1d8c-4a52-b072-12c5e3a0b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72238639-1d8c-4a52-b072-12c5e3a0b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c6b0bc-c134-4f1f-b77e-311fc19299f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:19 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:41:20 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e 1073741824" returned: 0 in 0.693s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:20 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e Nov 05 08:41:20 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c6b0bc-c134-4f1f-b77e-311fc19299f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13', 'volume_name': 'volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13', 'volume_size': 1, 'image_id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e60477ec15eabacf33e67f149db0d5c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c146b3d3c864cebb186aa6e209eaa1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '997ac002f303425842edf81a8591cc46ef83ec4d94a78fe3627f10e6b326615068f3c32682af5c82401219888c621286fd0272676b7bfadb5f39c4e475dfe183', 'id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f1f6d4-e5e0-4632-8625-826dcd64711b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f1f6d4-e5e0-4632-8625-826dcd64711b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1f7cc-9b8c-4ea3-8cf2-8752cfc632e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13', 'volume_size': 1, 'image_id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e60477ec15eabacf33e67f149db0d5c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c146b3d3c864cebb186aa6e209eaa1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '997ac002f303425842edf81a8591cc46ef83ec4d94a78fe3627f10e6b326615068f3c32682af5c82401219888c621286fd0272676b7bfadb5f39c4e475dfe183', 'id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c/file', 'properties': {}}, 'image_service': } Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Trying to clone 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 from image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:41:20 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7302d12c-536c-4f97-897b-e9f2590a424d]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:20 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1587323445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca01e7a3-0be9-4298-8090-ec6d30c315fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08ae40f82e44334943f2f29c59acf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:18Z,use_quota=True,user_id='854bdedf728e45b19193fd343e592280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Creating volume ca01e7a3-0be9-4298-8090-ec6d30c315fc {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:20 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5752f6c8-48c5-4fdb-bcec-9d0fc2b3d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5204265d-c92d-4522-b57a-a829a102529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:20 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc 1073741824 Nov 05 08:41:20 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:20 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Volume volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e (7a726f5a-d928-4dee-97bc-70ddc7a6739e): created successfully Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5204265d-c92d-4522-b57a-a829a102529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (2f64f86a-cb26-4ab0-b582-191365360fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-114a6ac0-3c91-4693-9f76-9398d37182ec tempest-CreateVolumesFromImageTest-1971085529 None] Created volume successfully. Nov 05 08:41:20 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:20 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:20 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:20 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:20 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc 1073741824" returned: 0 in 0.564s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Flow 'volume_create_manager' (224cebdd-1b91-422a-ac9c-5f251194c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a604db-7b1a-4b16-b6dc-cf4298221a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a604db-7b1a-4b16-b6dc-cf4298221a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb730b-b337-4a32-a75a-93f6bb5308e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d818bc73a84cbaa52b116f171808eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:21Z,use_quota=True,user_id='0472ed923a72436180ff61f03a96b614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0e9278b-05f1-41dc-b992-a8f96124c94b),volume_type_id=c0e9278b-05f1-41dc-b992-a8f96124c94b)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a50429-bb35-4dd4-b2ed-a4ea06fec776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a50429-bb35-4dd4-b2ed-a4ea06fec776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc39702f-201f-4db8-bfa1-854b4fa46065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.image.glance [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Creating Keystone auth plugin from conf {{(pid=87101) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:21 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc Nov 05 08:41:21 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Temporary image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c is fetched for user fb31075a51af4511b0c4dacfef812926. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede5d53b-67bd-4f0d-ac17-7f6cf4eb8d07]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:21 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc39702f-201f-4db8-bfa1-854b4fa46065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8bb730b-b337-4a32-a75a-93f6bb5308e9', 'volume_name': 'volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9', 'volume_size': 1, 'image_id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2239bda73b267f974191f43ed6d20062', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d818bc73a84cbaa52b116f171808eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fff6ed6372b22402ca002ac5fa47902839502b4becd4c0f750c3a0dc2839b231d919d36f7dcad9ed147c17a6eee553388edc6c129049114151963c93523a2402', 'id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27838192-c02a-4c9c-95a9-d2e8697a6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27838192-c02a-4c9c-95a9-d2e8697a6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10b3d5f-4548-48b0-be02-eb590c674550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Volume c8bb730b-b337-4a32-a75a-93f6bb5308e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9', 'volume_size': 1, 'image_id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2239bda73b267f974191f43ed6d20062', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d818bc73a84cbaa52b116f171808eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fff6ed6372b22402ca002ac5fa47902839502b4becd4c0f750c3a0dc2839b231d919d36f7dcad9ed147c17a6eee553388edc6c129049114151963c93523a2402', 'id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Trying to clone c8bb730b-b337-4a32-a75a-93f6bb5308e9 from image aeb54f9c-e11e-46cb-b14c-65ce1370a718 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}]). {{(pid=87101) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777eab8d-d774-4e1c-82e5-e2c3ebc00b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904d5529-e01f-4f07-8f4e-5f8e1f90d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Volume volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc (ca01e7a3-0be9-4298-8090-ec6d30c315fc): created successfully Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904d5529-e01f-4f07-8f4e-5f8e1f90d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Flow 'volume_create_manager' (36f610f7-7325-47bb-9e13-d849a745df26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c569e6aa-a547-41ce-8857-91e9e5a7bd16 tempest-CreateVolumesFromImageTest-1971085529 None] Created volume successfully. Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:41:21 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[258cf4e0-7f3d-44f5-a5be-95bf452d6347]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:21 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:21 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:21 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-ca01e7a3-0be9-4298-8090-ec6d30c315fc-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-ca01e7a3-0be9-4298-8090-ec6d30c315fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:21 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:21 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-quobyte-ca01e7a3-0be9-4298-8090-ec6d30c315fc" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-ca01e7a3-0be9-4298-8090-ec6d30c315fc" acquired by "delete_volume" :: waited 0.041s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7533551-72b4-4e77-bca1-7e61a1521a00]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc Nov 05 08:41:22 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:22 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 1 in 0.510s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c146b3d3c864cebb186aa6e209eaa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:20Z,use_quota=True,user_id='fb31075a51af4511b0c4dacfef812926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Creating volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:22 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1073741824 Nov 05 08:41:22 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc" returned: 0 in 0.374s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc Nov 05 08:41:22 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Temporary image aeb54f9c-e11e-46cb-b14c-65ce1370a718 is fetched for user 0472ed923a72436180ff61f03a96b614. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c3fdf0-2df7-45d5-b45f-5fddef58e1d2]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:22 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ca01e7a3-0be9-4298-8090-ec6d30c315fc" returned: 0 in 0.286s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1073741824" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-ca01e7a3-0be9-4298-8090-ec6d30c315fc" released by "delete_volume" :: held 0.753s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 Nov 05 08:41:22 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Created reservations ['90d4f2d7-e86b-4bf5-8be8-2a46594d5d58', '5b3e4061-5b74-4e5b-86c8-12dcd6113e24', '2fbbdcb7-3340-4b62-9286-16714c40827e', 'e0323896-e84f-487d-b702-865b3123b604'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:22 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:23 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-7a726f5a-d928-4dee-97bc-70ddc7a6739e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" returned: 0 in 0.328s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-7a726f5a-d928-4dee-97bc-70ddc7a6739e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Attempting download of 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c ((None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}])) to volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:41:23 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.299s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-quobyte-7a726f5a-d928-4dee-97bc-70ddc7a6739e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Deleted volume successfully. Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-7a726f5a-d928-4dee-97bc-70ddc7a6739e" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f92a3c1-aa33-44b3-8f99-f6ca574ef4f3 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-ca01e7a3-0be9-4298-8090-ec6d30c315fc-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81fd942-5a26-4056-9ad4-5854975b45fd]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0d957-99c1-4189-b091-259cb97ada12]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 1 in 0.459s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb730b-b337-4a32-a75a-93f6bb5308e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d818bc73a84cbaa52b116f171808eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:21Z,use_quota=True,user_id='0472ed923a72436180ff61f03a96b614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0e9278b-05f1-41dc-b992-a8f96124c94b),volume_type_id=c0e9278b-05f1-41dc-b992-a8f96124c94b)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Creating volume c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:23 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e Nov 05 08:41:23 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r Nov 05 08:41:23 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1073741824 Nov 05 08:41:23 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e" returned: 0 in 0.441s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e Nov 05 08:41:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r Nov 05 08:41:23 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1073741824" returned: 0 in 0.565s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 Nov 05 08:41:24 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r" returned: 1 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_ghobqw4r' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b37f7-a913-450f-a5e2-131299557b83]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-7a726f5a-d928-4dee-97bc-70ddc7a6739e" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-7a726f5a-d928-4dee-97bc-70ddc7a6739e" released by "delete_volume" :: held 0.914s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Created reservations ['717e3e1a-f521-4f44-bd18-e92c3c35438b', '80b3c179-af47-4491-b661-3a829106279d', 'e983cc5c-8d85-4d92-9d48-e611989cfd17', '6b9cc6c8-2f85-48b4-9aac-0cd2ae34ab3b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:24 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:24 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:24 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-020bd4e6-83d4-4213-8b10-f8650f0039bd-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:24 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-020bd4e6-83d4-4213-8b10-f8650f0039bd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:24 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Attempting download of aeb54f9c-e11e-46cb-b14c-65ce1370a718 ((None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}])) to volume c8bb730b-b337-4a32-a75a-93f6bb5308e9. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-quobyte-020bd4e6-83d4-4213-8b10-f8650f0039bd" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-020bd4e6-83d4-4213-8b10-f8650f0039bd" acquired by "delete_volume" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f4aef-21ee-418c-a95e-0e870828d01f]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c080f9-da4b-43d8-abf9-678b54dbac05]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Deleted volume successfully. Nov 05 08:41:24 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD Nov 05 08:41:24 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fdd6e296-7ddf-47b9-a9f8-4dbc4d734954 tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-7a726f5a-d928-4dee-97bc-70ddc7a6739e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:24 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc Nov 05 08:41:24 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd Nov 05 08:41:24 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c was raw, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:41:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 Nov 05 08:41:24 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc" returned: 0 in 0.468s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd" returned: 0 in 0.484s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd Nov 05 08:41:25 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc Nov 05 08:41:25 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc" returned: 1 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aeb54f9c-e11e-46cb-b14c-65ce1370a718_v9pku5gc' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:25 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[50de567d-aeba-4860-be8c-8805bbf8cae9]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-020bd4e6-83d4-4213-8b10-f8650f0039bd" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-020bd4e6-83d4-4213-8b10-f8650f0039bd" released by "delete_volume" :: held 0.969s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Created reservations ['bb7864c5-95eb-44fa-8b6a-28ce3b07ba04', 'd6f4db2a-f4d2-4d04-98fe-246d02982068', '45214fa9-6082-4207-98b6-28fc297cefb7', '23a6dd1a-7da5-47ae-a7b9-138c4f09ad60'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:25 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" returned: 0 in 0.675s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c_p883ymm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:41:25 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:25 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1G Nov 05 08:41:25 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:25 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 1G" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Downloaded image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c ((None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}])) to volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:41:26 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Temporary image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c for user fb31075a51af4511b0c4dacfef812926 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Marking volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.347s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Deleted volume successfully. Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Copying metadata from image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c to 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Creating volume glance metadata for volume 77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 backed by image 71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c with: {'image_id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e60477ec15eabacf33e67f149db0d5c5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:41:26 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD Nov 05 08:41:26 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21006485-56b0-46a3-a5da-a8b4dfdedfce tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-020bd4e6-83d4-4213-8b10-f8650f0039bd-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1f7cc-9b8c-4ea3-8cf2-8752cfc632e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13', 'volume_size': 1, 'image_id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e60477ec15eabacf33e67f149db0d5c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c146b3d3c864cebb186aa6e209eaa1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '997ac002f303425842edf81a8591cc46ef83ec4d94a78fe3627f10e6b326615068f3c32682af5c82401219888c621286fd0272676b7bfadb5f39c4e475dfe183', 'id': '71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71ab146d-8e87-4c6e-9eb3-ad587f3a4f8c/file', 'properties': {}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d17420-0894-4862-9cd3-2b355576ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:26 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Volume volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 (77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13): created successfully Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d17420-0894-4862-9cd3-2b355576ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Flow 'volume_create_manager' (02a0fcc6-35e9-4b68-aff8-d9a3a061c58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8fcfff9d-9426-400d-8b1f-9754c7573325 tempest-VolumeImageDependencyTests-772475399 None] Created volume successfully. Nov 05 08:41:26 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] aeb54f9c-e11e-46cb-b14c-65ce1370a718 was raw, converting to qcow2 {{(pid=87101) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 Nov 05 08:41:26 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-quobyte-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac28df4-574e-47c2-a47a-c00505ace894]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9" returned: 0 in 0.533s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aeb54f9c-e11e-46cb-b14c-65ce1370a718_qpu7nrs9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:41:26 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:41:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1G Nov 05 08:41:26 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 Nov 05 08:41:26 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:26 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" returned: 0 in 0.442s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Acquiring lock "cinder-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:27 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0 Nov 05 08:41:27 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "cinder-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:27 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 1G" returned: 0 in 0.459s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Downloaded image aeb54f9c-e11e-46cb-b14c-65ce1370a718 ((None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}])) to volume c8bb730b-b337-4a32-a75a-93f6bb5308e9 successfully. {{(pid=87101) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Temporary image aeb54f9c-e11e-46cb-b14c-65ce1370a718 for user 0472ed923a72436180ff61f03a96b614 is deleted. {{(pid=87101) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.volume_utils [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Marking volume c8bb730b-b337-4a32-a75a-93f6bb5308e9 as bootable. {{(pid=87101) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Acquiring lock "cinder-quobyte-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Copying metadata from image aeb54f9c-e11e-46cb-b14c-65ce1370a718 to c8bb730b-b337-4a32-a75a-93f6bb5308e9. {{(pid=87101) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Creating volume glance metadata for volume c8bb730b-b337-4a32-a75a-93f6bb5308e9 backed by image aeb54f9c-e11e-46cb-b14c-65ce1370a718 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2239bda73b267f974191f43ed6d20062', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87101) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "cinder-quobyte-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" acquired by "delete_volume" :: waited 0.025s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[467f9da2-e545-437c-81da-024bb3666b13]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10b3d5f-4548-48b0-be02-eb590c674550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9', 'volume_size': 1, 'image_id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2239bda73b267f974191f43ed6d20062', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d818bc73a84cbaa52b116f171808eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fff6ed6372b22402ca002ac5fa47902839502b4becd4c0f750c3a0dc2839b231d919d36f7dcad9ed147c17a6eee553388edc6c129049114151963c93523a2402', 'id': 'aeb54f9c-e11e-46cb-b14c-65ce1370a718', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aeb54f9c-e11e-46cb-b14c-65ce1370a718/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e740b6c-6728-4a0d-a462-372b998dc07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Volume volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 (c8bb730b-b337-4a32-a75a-93f6bb5308e9): created successfully Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e740b6c-6728-4a0d-a462-372b998dc07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Flow 'volume_create_manager' (224cebdd-1b91-422a-ac9c-5f251194c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:27 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a8007acb-8bd3-441e-9003-d828357674f2 tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Created volume successfully. Nov 05 08:41:27 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 Nov 05 08:41:27 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0" released by "delete_volume" :: held 0.859s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Created reservations ['7761542e-bd84-44dd-b2fd-4665285910c7', '2f4e560e-24f6-4270-8d7e-83b4675199b4', '24ffda5b-64f9-4477-aec8-4b6ca81c994a', 'a6c46352-d033-465c-87ff-570a1f297697'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:27 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-81ad5358-a039-4ef7-8b97-8ac5a860a464-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:27 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" returned: 0 in 0.480s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-81ad5358-a039-4ef7-8b97-8ac5a860a464-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:27 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13 Nov 05 08:41:27 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "cinder-quobyte-81ad5358-a039-4ef7-8b97-8ac5a860a464" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-81ad5358-a039-4ef7-8b97-8ac5a860a464" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[79570d4d-15bb-4d22-b248-b446129e25c3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:28 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Deleted volume successfully. Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-30229a08-c0a8-4767-b990-22e1b675a39f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-b2a7b59d-161a-4e51-b304-d40e1c9ad6f0-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:28 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 Nov 05 08:41:28 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:28 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" returned: 0 in 0.338s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "cinder-quobyte-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13" released by "delete_volume" :: held 0.879s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Created reservations ['0205f728-48cf-4807-9338-1472463dd78d', 'a930f822-78bc-450f-8461-502588a039fe', 'b4efafe6-1ec8-4cb7-bebf-717dc09a24fb', '71c03e47-596f-407a-a3dd-6c6f9432f83a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:28 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:28 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464" returned: 0 in 0.466s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464 Nov 05 08:41:28 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Acquiring lock "cinder-c8bb730b-b337-4a32-a75a-93f6bb5308e9-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "cinder-c8bb730b-b337-4a32-a75a-93f6bb5308e9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Flow 'volume_create_manager' (671bd3f9-cf88-4c1c-a4b9-6812ee804167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144b615f-7c09-494f-be1a-3244967edbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Acquiring lock "cinder-quobyte-c8bb730b-b337-4a32-a75a-93f6bb5308e9" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144b615f-7c09-494f-be1a-3244967edbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484677793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639029aa-0bae-472c-a8a6-abe4ef3e5be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13224b158694c92b590d0e7cce197b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:29Z,use_quota=True,user_id='94e5f5018fcd43fba5bef93f402c526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b03b37d-91b4-4d42-b590-e320f823409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b03b37d-91b4-4d42-b590-e320f823409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:28 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc9ace-3f66-4e25-9252-1d8137188d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc9ace-3f66-4e25-9252-1d8137188d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639029aa-0bae-472c-a8a6-abe4ef3e5be8', 'volume_name': 'volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b7b6e8-fa49-49b1-a21e-b2b60b20240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b7b6e8-fa49-49b1-a21e-b2b60b20240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43708ce-ed50-484e-b19e-f51fb3594201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:28 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Volume 639029aa-0bae-472c-a8a6-abe4ef3e5be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8', 'volume_size': 1} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484677793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639029aa-0bae-472c-a8a6-abe4ef3e5be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13224b158694c92b590d0e7cce197b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:29Z,use_quota=True,user_id='94e5f5018fcd43fba5bef93f402c526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Creating volume 639029aa-0bae-472c-a8a6-abe4ef3e5be8 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:28 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.538s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:28 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:28 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Deleted volume successfully. Nov 05 08:41:28 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "cinder-quobyte-c8bb730b-b337-4a32-a75a-93f6bb5308e9" acquired by "delete_volume" :: waited 0.115s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:29 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 1073741824 Nov 05 08:41:29 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-81ad5358-a039-4ef7-8b97-8ac5a860a464" returned: 0 in 0.488s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802dc3d-fa40-4432-86ff-d273e1b6e9cf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4903a43d-d11b-4ec5-9bc8-e3492aa2ace9 tempest-VolumeImageDependencyTests-772475399 None] Lock "cinder-77abe3fa-5ea8-4f2c-a5a2-bdb2f3417d13-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-quobyte-81ad5358-a039-4ef7-8b97-8ac5a860a464" released by "delete_volume" :: held 1.061s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Created reservations ['f8da89e5-0f83-419e-a6f7-dfae0978db1e', '13c225b5-98bb-436a-b18f-40e6e71c7d6e', '43b98de4-b35f-4203-8d84-cfe69e8b21e8', '95119254-6661-480a-b0a3-f955e75294ba'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:29 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 Nov 05 08:41:29 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:29 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9" returned: 0 in 0.451s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9 Nov 05 08:41:29 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 1073741824" returned: 0 in 0.623s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Deleted volume successfully. Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6f2bbad9-c8bf-424b-808a-99c089de523f tempest-CreateVolumesFromImageTest-1971085529 None] Lock "cinder-81ad5358-a039-4ef7-8b97-8ac5a860a464-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 Nov 05 08:41:29 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c8bb730b-b337-4a32-a75a-93f6bb5308e9" returned: 0 in 0.351s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "cinder-quobyte-c8bb730b-b337-4a32-a75a-93f6bb5308e9" released by "delete_volume" :: held 0.888s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43708ce-ed50-484e-b19e-f51fb3594201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:29 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbf8b08-e893-4c16-8510-06fd4eae6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:30 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Volume volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 (639029aa-0bae-472c-a8a6-abe4ef3e5be8): created successfully Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbf8b08-e893-4c16-8510-06fd4eae6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Flow 'volume_create_manager' (671bd3f9-cf88-4c1c-a4b9-6812ee804167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Created reservations ['00213728-04de-4be3-8d9b-fdcff06b7895', '1efd4fe4-613a-44d9-b26d-64b0cad737b2', 'd2e59962-3cd2-4edd-a323-dc383600083b', '89e0ec3a-c291-4376-9e93-f3d232702ad1'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:30 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c9b97e82-7476-4366-b36f-1f8bc2be54ec tempest-ProjectReaderTests-343414146 None] Created volume successfully. Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:30 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:30 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.272s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:30 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Deleted volume successfully. Nov 05 08:41:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-eb084181-a2df-4735-b247-ba5b0ad366ec tempest-VolumeAndVolumeTypeFromImageTest-1373147195 None] Lock "cinder-c8bb730b-b337-4a32-a75a-93f6bb5308e9-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Acquiring lock "cinder-639029aa-0bae-472c-a8a6-abe4ef3e5be8-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "cinder-639029aa-0bae-472c-a8a6-abe4ef3e5be8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Acquiring lock "cinder-quobyte-639029aa-0bae-472c-a8a6-abe4ef3e5be8" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "cinder-quobyte-639029aa-0bae-472c-a8a6-abe4ef3e5be8" acquired by "delete_volume" :: waited 0.036s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e44676-60d4-45a8-bbb6-cb05c14df67e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:31 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 Nov 05 08:41:31 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:31 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:31 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8 Nov 05 08:41:31 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:32 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-639029aa-0bae-472c-a8a6-abe4ef3e5be8" returned: 0 in 0.316s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "cinder-quobyte-639029aa-0bae-472c-a8a6-abe4ef3e5be8" released by "delete_volume" :: held 0.795s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Created reservations ['9a1e5cf4-25f0-462a-b551-3dec127f5cbe', 'a1d61a23-545c-4d6f-8c31-a7c328d77c46', '36264c77-5fed-4406-8880-e6b6c6148efc', '8bf6078a-9c0d-4d8d-a987-279035be7740'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:32 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:32 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:32 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.393s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:32 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Deleted volume successfully. Nov 05 08:41:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-143e2438-c2f4-4bad-92b3-8686c90db815 tempest-ProjectReaderTests-343414146 None] Lock "cinder-639029aa-0bae-472c-a8a6-abe4ef3e5be8-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Flow 'volume_create_manager' (b5b666c9-423d-47a4-a53e-2ff7e39a2d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6f41ec-b377-4653-af9d-9f990aaa385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6f41ec-b377-4653-af9d-9f990aaa385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313339312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d287da16-ec9c-40d0-aee1-56fc547ddada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13224b158694c92b590d0e7cce197b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:33Z,use_quota=True,user_id='94e5f5018fcd43fba5bef93f402c526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378f445e-00ea-4482-89ef-3a69fce51af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378f445e-00ea-4482-89ef-3a69fce51af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecec8480-03a6-44e4-8a77-1040fdff0f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecec8480-03a6-44e4-8a77-1040fdff0f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd287da16-ec9c-40d0-aee1-56fc547ddada', 'volume_name': 'volume-d287da16-ec9c-40d0-aee1-56fc547ddada', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecc52fb-1821-4d7c-8d41-d086bbbf93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecc52fb-1821-4d7c-8d41-d086bbbf93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b16c58c-0fda-4a0e-87a2-7e5012de966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:33 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Volume d287da16-ec9c-40d0-aee1-56fc547ddada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d287da16-ec9c-40d0-aee1-56fc547ddada', 'volume_size': 1} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313339312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d287da16-ec9c-40d0-aee1-56fc547ddada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13224b158694c92b590d0e7cce197b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:33Z,use_quota=True,user_id='94e5f5018fcd43fba5bef93f402c526f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Creating volume d287da16-ec9c-40d0-aee1-56fc547ddada {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:33 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:33 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada 1073741824 Nov 05 08:41:33 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:34 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada 1073741824" returned: 0 in 0.650s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:34 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada Nov 05 08:41:34 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (2c41c7fc-b74d-4d0b-80d5-e3d4c40cb2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f59974d-edeb-4864-9e83-3b19154efedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f59974d-edeb-4864-9e83-3b19154efedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287917223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33f955d-4ca0-45ac-b2d3-8ec9240aef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:34Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0696c5a-db63-4429-bfbc-cfb02afb90d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0696c5a-db63-4429-bfbc-cfb02afb90d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5751fc29-dec0-4b27-8422-a233ccb5cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5751fc29-dec0-4b27-8422-a233ccb5cf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33f955d-4ca0-45ac-b2d3-8ec9240aef91', 'volume_name': 'volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec21be5-22ef-4d26-8077-c2db0f6a5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec21be5-22ef-4d26-8077-c2db0f6a5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce65a478-7911-4439-8059-a99d6bc6e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Volume f33f955d-4ca0-45ac-b2d3-8ec9240aef91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91', 'volume_size': 1} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:34 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287917223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33f955d-4ca0-45ac-b2d3-8ec9240aef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:34Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Creating volume f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:34 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b16c58c-0fda-4a0e-87a2-7e5012de966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d287da16-ec9c-40d0-aee1-56fc547ddada', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07b041b-c84a-4c10-bb44-5e9782bf127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 1073741824 Nov 05 08:41:34 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Volume volume-d287da16-ec9c-40d0-aee1-56fc547ddada (d287da16-ec9c-40d0-aee1-56fc547ddada): created successfully Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07b041b-c84a-4c10-bb44-5e9782bf127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Flow 'volume_create_manager' (b5b666c9-423d-47a4-a53e-2ff7e39a2d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (2aef4c6b-d9f8-4e1e-98c0-9a42d82ed803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b623a-ea5e-4420-8721-5da89bacb7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d30ac786-ac99-4609-9509-a136c38d2cfb tempest-ProjectReaderTests-343414146 None] Created volume successfully. Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b623a-ea5e-4420-8721-5da89bacb7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826314144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d253accd-643b-4072-9c85-dbeb3f5a828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:35Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed74f9-ee89-4cf2-a514-bfdb466abc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed74f9-ee89-4cf2-a514-bfdb466abc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031a378d-fabb-4e8f-97ab-06773f670288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031a378d-fabb-4e8f-97ab-06773f670288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd253accd-643b-4072-9c85-dbeb3f5a828c', 'volume_name': 'volume-d253accd-643b-4072-9c85-dbeb3f5a828c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26da1b3-47be-4eec-a476-3074f369ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26da1b3-47be-4eec-a476-3074f369ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe16d990-f169-43a2-8bd0-350cadb5414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume d253accd-643b-4072-9c85-dbeb3f5a828c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d253accd-643b-4072-9c85-dbeb3f5a828c', 'volume_size': 1} Nov 05 08:41:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:35 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 1073741824" returned: 0 in 0.565s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:35 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 Nov 05 08:41:35 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:35 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826314144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d253accd-643b-4072-9c85-dbeb3f5a828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:35Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:35 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce65a478-7911-4439-8059-a99d6bc6e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881234c9-b023-41d8-838e-affee69fd310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:35 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c 1073741824 Nov 05 08:41:35 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Acquiring lock "cinder-d287da16-ec9c-40d0-aee1-56fc547ddada-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Volume volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 (f33f955d-4ca0-45ac-b2d3-8ec9240aef91): created successfully Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881234c9-b023-41d8-838e-affee69fd310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (2c41c7fc-b74d-4d0b-80d5-e3d4c40cb2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-3f1928fc-5e3b-4966-bd80-7022ce5f8da9 tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "cinder-d287da16-ec9c-40d0-aee1-56fc547ddada-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Acquiring lock "cinder-quobyte-d287da16-ec9c-40d0-aee1-56fc547ddada" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "cinder-quobyte-d287da16-ec9c-40d0-aee1-56fc547ddada" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cceb280-28d0-4775-921f-41e5dc0d5947]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:35 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada Nov 05 08:41:35 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:35 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c 1073741824" returned: 0 in 0.465s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:36 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c Nov 05 08:41:36 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:36 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:36 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada Nov 05 08:41:36 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:36 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c" returned: 0 in 0.262s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe16d990-f169-43a2-8bd0-350cadb5414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d253accd-643b-4072-9c85-dbeb3f5a828c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecae0b3d-5427-4637-a4dc-1174cef360d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:36 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-d253accd-643b-4072-9c85-dbeb3f5a828c (d253accd-643b-4072-9c85-dbeb3f5a828c): created successfully Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecae0b3d-5427-4637-a4dc-1174cef360d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (2aef4c6b-d9f8-4e1e-98c0-9a42d82ed803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-32b6073b-9546-40e1-9761-017fa3db34a0 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:36 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d287da16-ec9c-40d0-aee1-56fc547ddada" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "cinder-quobyte-d287da16-ec9c-40d0-aee1-56fc547ddada" released by "delete_volume" :: held 0.736s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Created reservations ['b52fa7c4-fff7-4ec7-b431-1a0c3c1c9d26', '84d474de-cf4b-4855-ac9d-2f7217752234', 'd4e16b15-700d-45ea-a850-61ce05eaf98d', 'a4fef280-c88b-4065-b70a-7c08a14ce5ff'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:36 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:36 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:36 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Deleted volume successfully. Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-90990448-b7a2-4ad3-a993-af0d1d44b16c tempest-ProjectReaderTests-343414146 None] Lock "cinder-d287da16-ec9c-40d0-aee1-56fc547ddada-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating offline snapshot 95f899df-914c-4964-8a0f-d820f92f330c of volume d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e621c-0d7c-49e6-b832-87945c8e90e2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:37 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c Nov 05 08:41:37 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:37 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c" returned: 0 in 0.481s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:37 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c 1G Nov 05 08:41:37 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e1ba9106-24e2-40c3-8196-201049076c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00461167-d7b7-43e5-a5a6-ad6015b4affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00461167-d7b7-43e5-a5a6-ad6015b4affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069435532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e59f5c-0fc6-48c1-a757-8d36d486fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:37Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f57cd03-0f00-460b-b5ad-23f68db72ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f57cd03-0f00-460b-b5ad-23f68db72ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c922a5-e6fd-415a-99ab-cfd3960be878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c922a5-e6fd-415a-99ab-cfd3960be878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e59f5c-0fc6-48c1-a757-8d36d486fa4a', 'volume_name': 'volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cbefd4-20f4-4032-988f-9a212a249589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cbefd4-20f4-4032-988f-9a212a249589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9bae5b-7a65-44b1-8c6f-3003489a5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:37 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume f9e59f5c-0fc6-48c1-a757-8d36d486fa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a', 'volume_size': 1} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:37 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c 1G" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d253accd-643b-4072-9c85-dbeb3f5a828c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:37 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d253accd-643b-4072-9c85-dbeb3f5a828c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c Nov 05 08:41:37 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:38 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d253accd-643b-4072-9c85-dbeb3f5a828c -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c" returned: 0 in 0.331s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:38 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c is being set with open permissions: ugo+rw Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:38 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c Nov 05 08:41:38 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:38 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:38 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info Nov 05 08:41:38 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:38 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:38 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info is being set with open permissions: ugo+rw Nov 05 08:41:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:38 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info Nov 05 08:41:38 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:39 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.info" returned: 0 in 0.312s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.115s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot d303ce59-da72-4fff-95f5-0e5b4d59fad3 of volume f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:41:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a2d6b92c-ec78-4646-a885-3f198e79adb7 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Create snapshot completed successfully Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[58220b5a-6351-4304-ad2a-5d426c3650d5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:39 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 Nov 05 08:41:39 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:39 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" returned: 0 in 0.364s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:39 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 1G Nov 05 08:41:39 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:39 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 1G" returned: 0 in 0.385s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:39 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 Nov 05 08:41:39 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:40 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3" returned: 0 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:40 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 is being set with open permissions: ugo+rw Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:40 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 Nov 05 08:41:40 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:40 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:40 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info Nov 05 08:41:40 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (1993f16d-119b-4eac-8a27-14ebdd37e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cac352-89a6-4118-a78f-9f8cf3ed2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cac352-89a6-4118-a78f-9f8cf3ed2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093533218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2cb27f-4846-4941-b21d-7767d36c1d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0974123-e9ca-49ab-95d8-742e17d4f315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0974123-e9ca-49ab-95d8-742e17d4f315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd33404-9b6a-4368-becf-c4427f6af7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd33404-9b6a-4368-becf-c4427f6af7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2cb27f-4846-4941-b21d-7767d36c1d80', 'volume_name': 'volume-ad2cb27f-4846-4941-b21d-7767d36c1d80', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d3bb7e-f349-4336-bfe0-531f85d46d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d3bb7e-f349-4336-bfe0-531f85d46d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c50c98-e73b-4fed-b147-891eb6199ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:40 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume ad2cb27f-4846-4941-b21d-7767d36c1d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2cb27f-4846-4941-b21d-7767d36c1d80', 'volume_size': 1} Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:40 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info" returned: 0 in 0.305s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:40 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info is being set with open permissions: ugo+rw Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:40 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info Nov 05 08:41:40 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:40 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (411b68ab-dd1f-42b0-a29d-3ac2caaf43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440d23fc-e06c-4827-89af-b9cce53fc462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440d23fc-e06c-4827-89af-b9cce53fc462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071486845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ffd8e-2886-469d-9200-dc16c8dd8a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fef0a1-acf3-4237-96d4-bb151006e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fef0a1-acf3-4237-96d4-bb151006e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d53703-a699-4958-8d9c-1c7585500cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d53703-a699-4958-8d9c-1c7585500cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2ffd8e-2886-469d-9200-dc16c8dd8a4e', 'volume_name': 'volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2c9785-5651-428d-9192-11ab7bfd15e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2c9785-5651-428d-9192-11ab7bfd15e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8e32e1-11a1-47bb-b1b9-6d05bcc24949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume 9d2ffd8e-2886-469d-9200-dc16c8dd8a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e', 'volume_size': 1} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:41 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.info" returned: 0 in 0.294s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.574s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069435532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e59f5c-0fc6-48c1-a757-8d36d486fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:37Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume f9e59f5c-0fc6-48c1-a757-8d36d486fa4a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:41 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:41 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a 1073741824 Nov 05 08:41:41 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2e5640d1-c6fd-47af-a0b0-0749aa93c905 tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (6b488741-a565-4c58-ab1c-c30f6b02ec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9540c607-bc73-4114-a302-ad0eb642de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9540c607-bc73-4114-a302-ad0eb642de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345726844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72151831-6d08-409d-8069-bf35a2f536f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f35625f-6964-4ba0-aba0-e19ccc682946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f35625f-6964-4ba0-aba0-e19ccc682946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae7c8b8-0e85-4846-890d-dcdb8be64842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae7c8b8-0e85-4846-890d-dcdb8be64842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72151831-6d08-409d-8069-bf35a2f536f4', 'volume_name': 'volume-72151831-6d08-409d-8069-bf35a2f536f4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f556d8db-528c-4ae3-b4a6-c69efe44ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f556d8db-528c-4ae3-b4a6-c69efe44ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40335a9d-2e2c-49ac-a617-d45449d5f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume 72151831-6d08-409d-8069-bf35a2f536f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72151831-6d08-409d-8069-bf35a2f536f4', 'volume_size': 1} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (ce4ab2d0-1fa9-4dc8-a299-b9a73296474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eb400e-5df0-48cc-80b4-d99e7a653581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a 1073741824" returned: 0 in 0.575s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eb400e-5df0-48cc-80b4-d99e7a653581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027213504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8127d697-3472-48ad-ad49-68c3dc5c976f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:42Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fa0915-ad2c-4bfc-a807-9d90656e5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fa0915-ad2c-4bfc-a807-9d90656e5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae68284-c0e5-4d3d-a20d-57037f50a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae68284-c0e5-4d3d-a20d-57037f50a96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8127d697-3472-48ad-ad49-68c3dc5c976f', 'volume_name': 'volume-8127d697-3472-48ad-ad49-68c3dc5c976f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65905372-d939-4d96-b9e9-f5dea2a158ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65905372-d939-4d96-b9e9-f5dea2a158ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ac62c5-ecb2-4bd8-a6be-e0d6d5a1295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:41 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume 8127d697-3472-48ad-ad49-68c3dc5c976f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8127d697-3472-48ad-ad49-68c3dc5c976f', 'volume_size': 1} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:41 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a Nov 05 08:41:41 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (447b8640-1752-40a6-a7a2-47bd30356aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee03327c-5391-4255-a4c3-76b5d8aacdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093533218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2cb27f-4846-4941-b21d-7767d36c1d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume ad2cb27f-4846-4941-b21d-7767d36c1d80 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee03327c-5391-4255-a4c3-76b5d8aacdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201698334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c063fe26-e5e6-43f3-8746-3cd13cecef29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:42Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 1073741824 Nov 05 08:41:42 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01ba282-0568-4610-85d3-1004f63f258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01ba282-0568-4610-85d3-1004f63f258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91195e60-468b-4a04-817a-01bdb9bcc91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91195e60-468b-4a04-817a-01bdb9bcc91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c063fe26-e5e6-43f3-8746-3cd13cecef29', 'volume_name': 'volume-c063fe26-e5e6-43f3-8746-3cd13cecef29', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5b8ab9-86ad-4bb6-a3a4-b9a827247fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5b8ab9-86ad-4bb6-a3a4-b9a827247fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0028bc22-4d2f-40f8-bbce-a97549c8f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume c063fe26-e5e6-43f3-8746-3cd13cecef29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c063fe26-e5e6-43f3-8746-3cd13cecef29', 'volume_size': 1} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9bae5b-7a65-44b1-8c6f-3003489a5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf524fdc-304e-4eaf-94c7-f5ef4e5f6553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a (f9e59f5c-0fc6-48c1-a757-8d36d486fa4a): created successfully Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf524fdc-304e-4eaf-94c7-f5ef4e5f6553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e1ba9106-24e2-40c3-8196-201049076c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-36d2ece1-535f-4c14-9850-11eb37fadea6 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-d303ce59-da72-4fff-95f5-0e5b4d59fad3-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d303ce59-da72-4fff-95f5-0e5b4d59fad3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-d303ce59-da72-4fff-95f5-0e5b4d59fad3" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d303ce59-da72-4fff-95f5-0e5b4d59fad3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot d303ce59-da72-4fff-95f5-0e5b4d59fad3 of volume f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[949005ae-e2bd-4a13-b234-cccafd04b564]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 Nov 05 08:41:42 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 1073741824" returned: 0 in 0.440s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 Nov 05 08:41:42 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3" returned: 0 in 0.386s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae8745-243e-4620-a38a-d7b795ae2cdb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071486845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ffd8e-2886-469d-9200-dc16c8dd8a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume 9d2ffd8e-2886-469d-9200-dc16c8dd8a4e {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c50c98-e73b-4fed-b147-891eb6199ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2cb27f-4846-4941-b21d-7767d36c1d80', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef2c35-49c5-404c-bbe0-b8d331342079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e 1073741824 Nov 05 08:41:42 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 Nov 05 08:41:42 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 (ad2cb27f-4846-4941-b21d-7767d36c1d80): created successfully Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef2c35-49c5-404c-bbe0-b8d331342079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (1993f16d-119b-4eac-8a27-14ebdd37e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b30855f8-2084-4e0d-9b6f-979181fd4b89 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:43 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" returned: 0 in 0.472s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:43 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 Nov 05 08:41:43 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (abcd0334-3913-4a5d-803e-b2636a3f9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c91b93-7e27-47a2-a4ef-906549b085cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c91b93-7e27-47a2-a4ef-906549b085cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180707916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad73e91-dc77-46e4-9adb-4442ba0a3192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9f54a5-6bd3-4c19-9124-1e3ae1a2ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9f54a5-6bd3-4c19-9124-1e3ae1a2ff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d85ba59-d4d7-4089-857e-6588e0c7b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d85ba59-d4d7-4089-857e-6588e0c7b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad73e91-dc77-46e4-9adb-4442ba0a3192', 'volume_name': 'volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923cd7f9-3a73-4a99-abac-9254fde199b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923cd7f9-3a73-4a99-abac-9254fde199b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828ba90c-8656-4515-9215-949a4af6fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume 9ad73e91-dc77-46e4-9adb-4442ba0a3192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192', 'volume_size': 1} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:43 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e 1073741824" returned: 0 in 0.588s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:43 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e Nov 05 08:41:43 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3" returned: 0 in 0.442s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:43 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3 Nov 05 08:41:43 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:43 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e94c671f-789e-4481-a4cf-1998b5dc4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3210093-91e9-4399-9733-540bf74a8ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" returned: 0 in 0.335s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345726844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72151831-6d08-409d-8069-bf35a2f536f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:41Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume 72151831-6d08-409d-8069-bf35a2f536f4 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:43 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3210093-91e9-4399-9733-540bf74a8ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352313754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e5349-8932-4956-9dc3-361b04a9b39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1b3be1-db71-498d-943e-e48126445dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1b3be1-db71-498d-943e-e48126445dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 1073741824 Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9685a305-ebde-4c6f-879d-54198004002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9685a305-ebde-4c6f-879d-54198004002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30e5349-8932-4956-9dc3-361b04a9b39a', 'volume_name': 'volume-c30e5349-8932-4956-9dc3-361b04a9b39a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e028bb38-f38f-4eb8-8a1f-1a606efe70cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e028bb38-f38f-4eb8-8a1f-1a606efe70cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6baf57e-5bde-4c82-9f35-7f89bfe15c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume c30e5349-8932-4956-9dc3-361b04a9b39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30e5349-8932-4956-9dc3-361b04a9b39a', 'volume_size': 1} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8e32e1-11a1-47bb-b1b9-6d05bcc24949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1983af-eb66-4805-af81-aabf4c579474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e (9d2ffd8e-2886-469d-9200-dc16c8dd8a4e): created successfully Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1983af-eb66-4805-af81-aabf4c579474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (411b68ab-dd1f-42b0-a29d-3ac2caaf43e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:43 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b7f641f3-f663-48a2-9c18-8bf968677f4b tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:44 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91.d303ce59-da72-4fff-95f5-0e5b4d59fad3" returned: 0 in 0.344s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d303ce59-da72-4fff-95f5-0e5b4d59fad3" released by "_delete_snapshot" :: held 1.812s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" released by "delete_snapshot" :: held 1.838s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Created reservations ['3a45e7db-009e-4f27-b08f-33810a54866f', '41633eb5-5b86-4d9c-b516-6fe92953a365', 'd88e07e9-94f7-461e-8ec6-b56648ce5368', '24e24c6f-2ee9-4021-9a90-53bf62f2f762'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (4f34a33d-1fa0-4837-b0d9-4c675b2e9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b9fca0-9ff5-43c4-9c9a-f4fc2be98774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b9fca0-9ff5-43c4-9c9a-f4fc2be98774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855070170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5069b2-80ae-4a95-8900-b0cef275ea2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b328661-6c29-4128-9e9d-96d24d804e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b328661-6c29-4128-9e9d-96d24d804e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5cc86c-cdfe-43ba-af16-eb58b4d97200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5cc86c-cdfe-43ba-af16-eb58b4d97200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5069b2-80ae-4a95-8900-b0cef275ea2b', 'volume_name': 'volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c513a7a7-20b0-4319-8893-1b042ce855b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c513a7a7-20b0-4319-8893-1b042ce855b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a82b28-9095-49f6-be5f-7084297ceace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume aa5069b2-80ae-4a95-8900-b0cef275ea2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b', 'volume_size': 1} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8c68196d-c201-4432-8e08-52c87d97e726 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d303ce59-da72-4fff-95f5-0e5b4d59fad3-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:44 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 1073741824" returned: 0 in 0.646s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:44 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 Nov 05 08:41:44 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-f33f955d-4ca0-45ac-b2d3-8ec9240aef91-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "cinder-f33f955d-4ca0-45ac-b2d3-8ec9240aef91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e4fe04ff-9dd9-4c13-8672-0c98d5cc7a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4784be-a77c-4b70-8277-eb517d41da01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" acquired by "delete_volume" :: waited 0.050s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4784be-a77c-4b70-8277-eb517d41da01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064836660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90e1371-0340-410e-bd82-63a1291f695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1c8027-a572-4366-b531-aab819c1f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1c8027-a572-4366-b531-aab819c1f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf6980-a814-446b-9fb9-f1672e2a3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf6980-a814-446b-9fb9-f1672e2a3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90e1371-0340-410e-bd82-63a1291f695c', 'volume_name': 'volume-f90e1371-0340-410e-bd82-63a1291f695c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd29a1bf-dd62-438b-a66b-7704b049bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd29a1bf-dd62-438b-a66b-7704b049bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dd5b9f-fc6c-4180-b1f2-0ef7f50d4b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume f90e1371-0340-410e-bd82-63a1291f695c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90e1371-0340-410e-bd82-63a1291f695c', 'volume_size': 1} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1641c9e-5e5b-4ac2-ad75-ad25947e9aef]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027213504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8127d697-3472-48ad-ad49-68c3dc5c976f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:42Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume 8127d697-3472-48ad-ad49-68c3dc5c976f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:44 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40335a9d-2e2c-49ac-a617-d45449d5f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72151831-6d08-409d-8069-bf35a2f536f4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f 1073741824 Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a2db8c-3742-4133-8ba7-8b07c1654dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-72151831-6d08-409d-8069-bf35a2f536f4 (72151831-6d08-409d-8069-bf35a2f536f4): created successfully Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a2db8c-3742-4133-8ba7-8b07c1654dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (6b488741-a565-4c58-ab1c-c30f6b02ec8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f236be33-661b-4ce5-a3f2-26599289f186 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:45 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 Nov 05 08:41:45 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (5b2a2b59-5d73-4718-9bcb-a296a94a5cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b5294-21ad-4637-be51-53d8689bfc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b5294-21ad-4637-be51-53d8689bfc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1691793168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b2578c-99b4-42e7-91aa-c0114d819f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cdf189-4d0a-45f7-908d-bb8039e8f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cdf189-4d0a-45f7-908d-bb8039e8f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17644a70-3d0d-47b2-a275-ec76e850bbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17644a70-3d0d-47b2-a275-ec76e850bbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b2578c-99b4-42e7-91aa-c0114d819f3d', 'volume_name': 'volume-73b2578c-99b4-42e7-91aa-c0114d819f3d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7147826d-7255-40df-8489-66166a30fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7147826d-7255-40df-8489-66166a30fc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45fd0d1-fbeb-49c8-af68-4faf0dc7595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume 73b2578c-99b4-42e7-91aa-c0114d819f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b2578c-99b4-42e7-91aa-c0114d819f3d', 'volume_size': 1} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" returned: 0 in 0.442s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91 Nov 05 08:41:45 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f 1073741824" returned: 0 in 0.491s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f Nov 05 08:41:45 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-f33f955d-4ca0-45ac-b2d3-8ec9240aef91" released by "delete_volume" :: held 0.835s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Created reservations ['9cb6fb88-bbe5-44ec-b8a5-d7150887cd5b', '5b9a9522-5430-4a87-a3a8-40cd18980b41', '7bf69e64-600c-4d38-a87e-fa398e6f4bd1', '7b0bee42-ffd8-4283-9322-7cb1b84d5471'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:45 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.606s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201698334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c063fe26-e5e6-43f3-8746-3cd13cecef29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2c6e1a1f234d539f46a6e8f723b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:42Z,use_quota=True,user_id='83c7dc832a4740a68eede71e6409b857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Creating volume c063fe26-e5e6-43f3-8746-3cd13cecef29 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 1073741824 Nov 05 08:41:45 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ac62c5-ecb2-4bd8-a6be-e0d6d5a1295b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8127d697-3472-48ad-ad49-68c3dc5c976f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2e4e05-fd2b-4a62-bee3-6416ad280430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-8127d697-3472-48ad-ad49-68c3dc5c976f (8127d697-3472-48ad-ad49-68c3dc5c976f): created successfully Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2e4e05-fd2b-4a62-bee3-6416ad280430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (ce4ab2d0-1fa9-4dc8-a299-b9a73296474b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:45 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dad02b0d-dda5-41e1-87cd-f1f4906884dd tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:46 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.311s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c15e0de7-35cb-43ba-9f61-02490919cbff tempest-ProjectMemberTests-2076759849 None] Lock "cinder-f33f955d-4ca0-45ac-b2d3-8ec9240aef91-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:46 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 1073741824" returned: 0 in 0.518s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:46 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 Nov 05 08:41:46 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (f0e0d5df-09da-4562-a89b-d77c48b770fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd6b8aa-67ad-4a6e-9e2c-b2f186d6c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd6b8aa-67ad-4a6e-9e2c-b2f186d6c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183410700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f3673-eff2-42b0-9d20-969e2a75b636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:46Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb84740-69af-4b05-92de-a83e97b09f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb84740-69af-4b05-92de-a83e97b09f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f81803e-52d7-42dd-842b-71833a4ff99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f81803e-52d7-42dd-842b-71833a4ff99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2f3673-eff2-42b0-9d20-969e2a75b636', 'volume_name': 'volume-2a2f3673-eff2-42b0-9d20-969e2a75b636', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6f20f9-650d-47b7-a6f5-c9573f44d895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6f20f9-650d-47b7-a6f5-c9573f44d895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528efde1-df92-4f7f-bcd6-cad462232236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Volume 2a2f3673-eff2-42b0-9d20-969e2a75b636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2f3673-eff2-42b0-9d20-969e2a75b636', 'volume_size': 1} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:46 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29" returned: 0 in 0.239s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180707916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad73e91-dc77-46e4-9adb-4442ba0a3192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume 9ad73e91-dc77-46e4-9adb-4442ba0a3192 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:46 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0028bc22-4d2f-40f8-bbce-a97549c8f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c063fe26-e5e6-43f3-8746-3cd13cecef29', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 1073741824 Nov 05 08:41:46 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef465756-0093-4182-ad4c-a1436f5fb5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Volume volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 (c063fe26-e5e6-43f3-8746-3cd13cecef29): created successfully Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef465756-0093-4182-ad4c-a1436f5fb5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Flow 'volume_create_manager' (447b8640-1752-40a6-a7a2-47bd30356aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b65cfcbb-94c2-4272-91e7-41d2a771b284 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created volume successfully. Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-c063fe26-e5e6-43f3-8746-3cd13cecef29-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-c063fe26-e5e6-43f3-8746-3cd13cecef29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-c063fe26-e5e6-43f3-8746-3cd13cecef29" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-c063fe26-e5e6-43f3-8746-3cd13cecef29" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba8b16-2e7f-4dda-92ba-e7b215bff62b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 1073741824" returned: 0 in 0.484s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 Nov 05 08:41:47 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 Nov 05 08:41:47 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.449s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352313754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e5349-8932-4956-9dc3-361b04a9b39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume c30e5349-8932-4956-9dc3-361b04a9b39a {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:47 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828ba90c-8656-4515-9215-949a4af6fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:47 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a 1073741824 Nov 05 08:41:47 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa4a156-7221-42d9-8429-1b1c33e84359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 (9ad73e91-dc77-46e4-9adb-4442ba0a3192): created successfully Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa4a156-7221-42d9-8429-1b1c33e84359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (abcd0334-3913-4a5d-803e-b2636a3f9acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:47 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ddc84404-5caf-4569-82c6-90d5cffe3fda tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:47 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29" returned: 0 in 0.404s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29 Nov 05 08:41:47 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c063fe26-e5e6-43f3-8746-3cd13cecef29" returned: 0 in 0.273s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-c063fe26-e5e6-43f3-8746-3cd13cecef29" released by "delete_volume" :: held 0.723s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['fd1c831d-0377-49e0-b1ec-68fbfc11cbe4', '26480cea-2180-4d5e-a25d-7ee30258b352', '24deed7f-a27f-477c-ab46-c0a9fb7c9cc6', 'fa7dcb79-4f5d-4f0e-bcac-da2d0a4eb276'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:47 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a 1073741824" returned: 0 in 0.466s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:47 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a Nov 05 08:41:47 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-8127d697-3472-48ad-ad49-68c3dc5c976f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-8127d697-3472-48ad-ad49-68c3dc5c976f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:48 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.782s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855070170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5069b2-80ae-4a95-8900-b0cef275ea2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume aa5069b2-80ae-4a95-8900-b0cef275ea2b {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:48 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6baf57e-5bde-4c82-9f35-7f89bfe15c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30e5349-8932-4956-9dc3-361b04a9b39a', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b 1073741824 Nov 05 08:41:48 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5717f06-ce7b-4dd0-9688-117059ab9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-989a9259-67b7-42c2-ab34-3006fb1f2bb2 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-c063fe26-e5e6-43f3-8746-3cd13cecef29-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-c30e5349-8932-4956-9dc3-361b04a9b39a (c30e5349-8932-4956-9dc3-361b04a9b39a): created successfully Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5717f06-ce7b-4dd0-9688-117059ab9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e94c671f-789e-4481-a4cf-1998b5dc4427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-8127d697-3472-48ad-ad49-68c3dc5c976f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a75d8804-5ea1-4538-a41b-282d25311c29 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-8127d697-3472-48ad-ad49-68c3dc5c976f" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb9643-3a94-4669-ba4c-b06731cfa19a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f Nov 05 08:41:48 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:48 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b 1073741824" returned: 0 in 0.491s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b Nov 05 08:41:48 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f" returned: 0 in 0.440s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f Nov 05 08:41:48 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:41:48 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b" returned: 0 in 0.269s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.072s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064836660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90e1371-0340-410e-bd82-63a1291f695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume f90e1371-0340-410e-bd82-63a1291f695c {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a82b28-9095-49f6-be5f-7084297ceace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c 1073741824 Nov 05 08:41:49 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09aa487-1885-4b8e-af59-11549beaf3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b (aa5069b2-80ae-4a95-8900-b0cef275ea2b): created successfully Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09aa487-1885-4b8e-af59-11549beaf3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (4f34a33d-1fa0-4837-b0d9-4c675b2e9887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-8127d697-3472-48ad-ad49-68c3dc5c976f" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ddef94de-e87f-4bfd-ae8e-2a438c883aee tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-8127d697-3472-48ad-ad49-68c3dc5c976f" released by "delete_volume" :: held 0.807s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['52d4f12d-6bd9-472e-ab69-eada7dec4f96', 'ef2d01ac-9b81-4505-a947-43c30fd8319b', '608e1cb7-3219-4556-a6df-3ba20d941c3a', 'b1d069a5-9f8d-43fb-ae71-d19161919235'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:49 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-72151831-6d08-409d-8069-bf35a2f536f4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-72151831-6d08-409d-8069-bf35a2f536f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-72151831-6d08-409d-8069-bf35a2f536f4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-72151831-6d08-409d-8069-bf35a2f536f4" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8f5df-596d-4853-9742-36f19e5bd34f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a3160a10-e15c-4590-bf44-6ddfb333b073 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-8127d697-3472-48ad-ad49-68c3dc5c976f-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:49 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c 1073741824" returned: 0 in 0.548s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 Nov 05 08:41:49 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c Nov 05 08:41:49 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4" returned: 0 in 0.385s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.617s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1691793168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b2578c-99b4-42e7-91aa-c0114d819f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4ff006b32a416da1824d9066c2e118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='7bcf9f097767402c933b0c09999fa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Creating volume 73b2578c-99b4-42e7-91aa-c0114d819f3d {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:49 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4 Nov 05 08:41:49 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dd5b9f-fc6c-4180-b1f2-0ef7f50d4b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90e1371-0340-410e-bd82-63a1291f695c', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91994a8b-5f24-477d-9a68-bf4dbf459505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d 1073741824 Nov 05 08:41:49 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-f90e1371-0340-410e-bd82-63a1291f695c (f90e1371-0340-410e-bd82-63a1291f695c): created successfully Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91994a8b-5f24-477d-9a68-bf4dbf459505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (e4fe04ff-9dd9-4c13-8672-0c98d5cc7a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6f729646-0e81-4494-89a8-e37fac523fc9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:50 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-72151831-6d08-409d-8069-bf35a2f536f4" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-72151831-6d08-409d-8069-bf35a2f536f4" released by "delete_volume" :: held 0.703s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['bb0d118e-a9ec-44a7-9eb3-b976351dbb80', '4ce2a341-5e67-4e93-8649-76c39b88817b', '35ff06a7-e102-4c15-bf27-bdc4577f21f0', 'df3cd1ad-4022-4f74-a049-098d3d109331'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:50 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d 1073741824" returned: 0 in 0.478s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d Nov 05 08:41:50 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8b483cba-9c43-42e7-9a67-dcf15c6cc224 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-72151831-6d08-409d-8069-bf35a2f536f4-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f91fb3-defc-46aa-a032-0ae9c42bdd04]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d" returned: 0 in 0.267s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.210s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183410700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f3673-eff2-42b0-9d20-969e2a75b636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:46Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Creating volume 2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:50 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 1073741824 Nov 05 08:41:50 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45fd0d1-fbeb-49c8-af68-4faf0dc7595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b2578c-99b4-42e7-91aa-c0114d819f3d', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf50a564-453d-4abd-9f86-61ae648c594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Volume volume-73b2578c-99b4-42e7-91aa-c0114d819f3d (73b2578c-99b4-42e7-91aa-c0114d819f3d): created successfully Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf50a564-453d-4abd-9f86-61ae648c594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Flow 'volume_create_manager' (5b2a2b59-5d73-4718-9bcb-a296a94a5cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:50 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-84d67d24-3f5a-4711-9636-e1866d4c2318 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created volume successfully. Nov 05 08:41:50 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e Nov 05 08:41:50 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" returned: 0 in 0.390s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e Nov 05 08:41:51 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 1073741824" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 Nov 05 08:41:51 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e" released by "delete_volume" :: held 0.693s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['381c3b4b-c060-4c1d-b15a-f3365bfa3c59', '478ff057-9277-4c2f-9687-de956ba6d6a8', '1dd3ffa9-b0ad-4574-bfdf-61144e119e7a', 'dbd70840-e20a-402c-8e2e-46eba60d48ac'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:51 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:51 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528efde1-df92-4f7f-bcd6-cad462232236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2f3673-eff2-42b0-9d20-969e2a75b636', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730d14e2-258c-4622-8325-3d6703deafca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Volume volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 (2a2f3673-eff2-42b0-9d20-969e2a75b636): created successfully Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730d14e2-258c-4622-8325-3d6703deafca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (f0e0d5df-09da-4562-a89b-d77c48b770fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-404bdaa3-e8b5-40cc-8090-b34b6ade668a tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:41:51 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-ad2cb27f-4846-4941-b21d-7767d36c1d80-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d39f6255-b80e-4114-8982-b8b982a68737 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-9d2ffd8e-2886-469d-9200-dc16c8dd8a4e-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-ad2cb27f-4846-4941-b21d-7767d36c1d80-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-ad2cb27f-4846-4941-b21d-7767d36c1d80" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-ad2cb27f-4846-4941-b21d-7767d36c1d80" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64f380a-adde-457f-98f1-9dd7c89b27e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-73b2578c-99b4-42e7-91aa-c0114d819f3d-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:51 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-73b2578c-99b4-42e7-91aa-c0114d819f3d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:51 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot 5b4068b3-521d-4913-abca-4aee08b672ff of volume 2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-73b2578c-99b4-42e7-91aa-c0114d819f3d" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49381de-4ea4-469d-acfb-977bc888e22c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-73b2578c-99b4-42e7-91aa-c0114d819f3d" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dad9f0-f4d8-4e03-9831-d7a2399b6245]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 Nov 05 08:41:52 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d Nov 05 08:41:52 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80 Nov 05 08:41:52 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d" returned: 0 in 0.379s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff 1G Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d Nov 05 08:41:52 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ad2cb27f-4846-4941-b21d-7767d36c1d80" returned: 0 in 0.278s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-ad2cb27f-4846-4941-b21d-7767d36c1d80" released by "delete_volume" :: held 0.746s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['ebc89f6a-5f5a-4d51-a801-2396dec99de3', 'cc659d3e-50e4-4a68-ac76-9b7a0894ee67', '39678273-2574-4025-b16a-33ff5bfb4188', 'e209ed2a-6695-4955-88da-5e0d8c7bb1bd'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:52 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-73b2578c-99b4-42e7-91aa-c0114d819f3d" returned: 0 in 0.273s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-73b2578c-99b4-42e7-91aa-c0114d819f3d" released by "delete_volume" :: held 0.701s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['facd7a87-e115-4cab-a0c9-16d1bc8e2b2c', 'cde82858-f949-4959-9a3e-874303c45b78', '559e7ccd-53bb-4df2-935b-2efde6d65fa8', '1dcdb538-2a70-4b6d-8d29-6ad996323a3b'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-95f899df-914c-4964-8a0f-d820f92f330c-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff 1G" returned: 0 in 0.512s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:52 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-95f899df-914c-4964-8a0f-d820f92f330c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:52 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff Nov 05 08:41:52 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-95f899df-914c-4964-8a0f-d820f92f330c" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:53 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-95f899df-914c-4964-8a0f-d820f92f330c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleting offline snapshot 95f899df-914c-4964-8a0f-d820f92f330c of volume d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] snapshot_file for this snap is: volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:41:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec9648-9329-4701-ade6-2ca171605673]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4cb4a673-5130-4b8d-b9f2-a5dc063dd551 tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-ad2cb27f-4846-4941-b21d-7767d36c1d80-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-f90e1371-0340-410e-bd82-63a1291f695c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-f90e1371-0340-410e-bd82-63a1291f695c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-f90e1371-0340-410e-bd82-63a1291f695c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-f90e1371-0340-410e-bd82-63a1291f695c" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:53 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:53 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b229ea-7c10-4205-b0fb-16e1db12ac4a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c Nov 05 08:41:53 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a9247aec-2337-4ef2-99cb-7d1a9812f77c tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-73b2578c-99b4-42e7-91aa-c0114d819f3d-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:53 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff" returned: 0 in 0.410s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff is being set with open permissions: ugo+rw Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff Nov 05 08:41:53 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c Nov 05 08:41:53 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c" returned: 0 in 0.481s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d253accd-643b-4072-9c85-dbeb3f5a828c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:41:53 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1363498-2320-4e90-894c-724af6fc53e3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info Nov 05 08:41:53 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c" returned: 0 in 0.415s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c Nov 05 08:41:53 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c Nov 05 08:41:53 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info is being set with open permissions: ugo+rw Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info Nov 05 08:41:53 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f90e1371-0340-410e-bd82-63a1291f695c" returned: 0 in 0.277s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-f90e1371-0340-410e-bd82-63a1291f695c" released by "delete_volume" :: held 0.752s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['a57e76db-09ea-4db1-a027-0b5beb25da99', 'a028dd5b-d5d2-4981-9a1d-1157e41521b8', 'dd637906-5383-4cef-ae86-75633fe9cfa2', '24bfcefa-a271-4f24-8160-284e829ee42f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:54 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c Nov 05 08:41:54 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:54 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.info" returned: 0 in 0.279s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-57f84af3-e8ef-4d96-892d-1ee494bb8982 tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-aa5069b2-80ae-4a95-8900-b0cef275ea2b-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-aa5069b2-80ae-4a95-8900-b0cef275ea2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-aa5069b2-80ae-4a95-8900-b0cef275ea2b" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-aa5069b2-80ae-4a95-8900-b0cef275ea2b" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.303s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e70836-b4a6-4adb-822e-050f5c550b69]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c" returned: 0 in 0.439s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-c159f897-69d6-45fa-b661-446ec20dac6f tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-f90e1371-0340-410e-bd82-63a1291f695c-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c Nov 05 08:41:54 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b Nov 05 08:41:54 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c.95f899df-914c-4964-8a0f-d820f92f330c" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-95f899df-914c-4964-8a0f-d820f92f330c" released by "_delete_snapshot" :: held 1.757s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" released by "delete_snapshot" :: held 1.793s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b" returned: 0 in 0.362s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b Nov 05 08:41:54 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['97261568-f56f-44c4-9b7e-dd55f2a3cbd6', '6439e98f-f243-42ee-bbba-95c712743b6b', '3cefd608-a150-4cd7-960c-51066df7d563', '8991fa3e-8db9-4d21-ae04-15d9f40d15b5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Delete snapshot completed successfully. Nov 05 08:41:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5efe27e8-4dde-41c2-99e1-51ddcac3f7bb tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-95f899df-914c-4964-8a0f-d820f92f330c-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-5b4068b3-521d-4913-abca-4aee08b672ff-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-aa5069b2-80ae-4a95-8900-b0cef275ea2b" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-d253accd-643b-4072-9c85-dbeb3f5a828c-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-5b4068b3-521d-4913-abca-4aee08b672ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-aa5069b2-80ae-4a95-8900-b0cef275ea2b" released by "delete_volume" :: held 0.720s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-5b4068b3-521d-4913-abca-4aee08b672ff" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-d253accd-643b-4072-9c85-dbeb3f5a828c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-5b4068b3-521d-4913-abca-4aee08b672ff" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot 5b4068b3-521d-4913-abca-4aee08b672ff of volume 2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[44833be6-b3d9-43a6-b928-2f85d1b8a142]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['44dd37cf-81f2-4124-a2ff-068358002e73', '970273c4-ff7c-4b3d-9289-5a213e3494cb', '6ac9b515-bb72-4d32-9e14-8c51b6bab926', '1e78e4c0-b102-44c8-b99b-09284b25daf2'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc3010-76f8-4d4c-b357-29e8c4d007af]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff Nov 05 08:41:55 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:55 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c Nov 05 08:41:55 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-c30e5349-8932-4956-9dc3-361b04a9b39a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-c30e5349-8932-4956-9dc3-361b04a9b39a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-c30e5349-8932-4956-9dc3-361b04a9b39a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-c30e5349-8932-4956-9dc3-361b04a9b39a" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a74f5-3c15-487e-9d8e-f139817f6bcf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2f3673-eff2-42b0-9d20-969e2a75b636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:41:55 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.311s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba42bfa-568a-4df9-af97-53f089f1cd6f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a18c85fa-666e-4482-b076-736723f057ea tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-aa5069b2-80ae-4a95-8900-b0cef275ea2b-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c" returned: 0 in 0.469s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c Nov 05 08:41:55 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 Nov 05 08:41:55 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d253accd-643b-4072-9c85-dbeb3f5a828c" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-quobyte-d253accd-643b-4072-9c85-dbeb3f5a828c" released by "delete_volume" :: held 0.814s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636" returned: 0 in 0.405s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a Nov 05 08:41:56 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff Nov 05 08:41:56 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Created reservations ['0327c00c-7674-4d71-b02f-811b7b0cc811', 'c647e608-a0a6-4f81-a1f0-f5b6066d0801', '3f1884b1-9b75-4d4d-943e-0fd8ba763c97', '83066f91-ab8f-42b4-91fa-9f9917305280'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:56 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-c30e5349-8932-4956-9dc3-361b04a9b39a" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-c30e5349-8932-4956-9dc3-361b04a9b39a" released by "delete_volume" :: held 0.781s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['d3b77124-f5c2-4100-96fa-da8bc18c29da', 'f2a37fd0-b552-44ca-808b-df1c394b9636', '546be11c-6d05-4f77-b082-c8369e0a78bc', 'ad23d8ce-95ab-4bf7-bc46-4a5331b67eed'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:56 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:56 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.321s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Deleted volume successfully. Nov 05 08:41:56 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff Nov 05 08:41:56 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bb482cd8-5fe1-48c5-a971-8d0b77e8971f tempest-CreateVolumesFromSnapshotTest-1332326075 None] Lock "cinder-d253accd-643b-4072-9c85-dbeb3f5a828c-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-9ad73e91-dc77-46e4-9adb-4442ba0a3192-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-9ad73e91-dc77-46e4-9adb-4442ba0a3192-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-9ad73e91-dc77-46e4-9adb-4442ba0a3192" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-9ad73e91-dc77-46e4-9adb-4442ba0a3192" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:56 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c76ac-9356-4574-a280-04ecda7edb21]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6e711913-201c-4f89-b11c-1e0617e0462a tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-c30e5349-8932-4956-9dc3-361b04a9b39a-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636.5b4068b3-521d-4913-abca-4aee08b672ff" returned: 0 in 0.381s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-5b4068b3-521d-4913-abca-4aee08b672ff" released by "_delete_snapshot" :: held 1.796s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" released by "delete_snapshot" :: held 1.837s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 Nov 05 08:41:57 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Created reservations ['6c0f8453-0c89-4ec4-b3ef-7ba5ec7c41dc', '7857f0ff-d3e1-4ee8-9e07-08478a79223c', '1d255c85-513b-4c24-bb5b-0d5845a7f484', 'fd61c588-d315-46c7-9c3d-be388a2cef37'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-13d04baf-4d11-496f-9e12-116d14912d24 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-5b4068b3-521d-4913-abca-4aee08b672ff-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-2a2f3673-eff2-42b0-9d20-969e2a75b636-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:57 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192" returned: 0 in 0.463s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-2a2f3673-eff2-42b0-9d20-969e2a75b636-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:57 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192 Nov 05 08:41:57 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd8f48-04ac-4251-b0f3-faf0a672df3b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 Nov 05 08:41:57 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-9ad73e91-dc77-46e4-9adb-4442ba0a3192" returned: 0 in 0.285s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-9ad73e91-dc77-46e4-9adb-4442ba0a3192" released by "delete_volume" :: held 0.809s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['3087310d-02f3-4c16-9097-6af217b8ca28', '28d3d78e-100e-480b-bf74-7630137bb27d', '8cfc9c6e-941f-46b6-a751-1cb8dab17c18', '2ee87dac-b9f5-4aeb-ae9e-204410588be3'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:57 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636" returned: 0 in 0.422s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:57 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636 Nov 05 08:41:57 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "cinder-quobyte-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[713496b1-51e9-4d80-9e7a-1e798637f4e3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.312s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-38e3fc59-3594-4383-91da-bb3fa169c8c9 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-9ad73e91-dc77-46e4-9adb-4442ba0a3192-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:58 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a Nov 05 08:41:58 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-2a2f3673-eff2-42b0-9d20-969e2a75b636" returned: 0 in 0.314s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-2a2f3673-eff2-42b0-9d20-969e2a75b636" released by "delete_volume" :: held 0.820s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Created reservations ['b7f45ba9-cc85-4d84-a6ca-37ed25085b13', '151436fe-3e6f-4a20-960a-e017494cafd8', 'ac11d632-f1f7-4de4-83c7-4437414a2e9c', '17f33be2-ea7b-41be-b211-3b2619705a9c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:58 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" returned: 0 in 0.455s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a Nov 05 08:41:58 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.317s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-79032b94-4972-4fc9-a8d2-22edcb0a9ee2 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-2a2f3673-eff2-42b0-9d20-969e2a75b636-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:58 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" returned: 0 in 0.330s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-quobyte-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a" released by "delete_volume" :: held 0.850s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:58 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Created reservations ['1dff13e2-bb40-4d15-81ff-629636eeea90', '6acf758e-a216-4591-b0be-c3030e83a691', '98bc2efd-ff9e-440f-8d40-45aca0776890', 'e1e46596-08dc-4d53-a742-02ed810b33e4'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (777353b4-55ea-4dbe-8b9f-be262d4c0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8671caf6-e3ec-49ef-a832-99c7240dae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:41:59 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8671caf6-e3ec-49ef-a832-99c7240dae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493960959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311837c0-8644-44bd-b0ba-fe2d64321562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:59Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b71c1f-c06f-48c9-b1d8-a98e93adf0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b71c1f-c06f-48c9-b1d8-a98e93adf0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b753283-5085-4d01-9c28-5d0997c6d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b753283-5085-4d01-9c28-5d0997c6d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311837c0-8644-44bd-b0ba-fe2d64321562', 'volume_name': 'volume-311837c0-8644-44bd-b0ba-fe2d64321562', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0458c-3ea0-4525-9e9d-9ee094d40363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0458c-3ea0-4525-9e9d-9ee094d40363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e5632a-8497-4e1a-bf5e-70bf982f4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Volume 311837c0-8644-44bd-b0ba-fe2d64321562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311837c0-8644-44bd-b0ba-fe2d64321562', 'volume_size': 1} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493960959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311837c0-8644-44bd-b0ba-fe2d64321562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:59Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Creating volume 311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:59 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 1073741824 Nov 05 08:41:59 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.321s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Deleted volume successfully. Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e3a772a-3d9c-4182-af85-fd91f8ded950 tempest-CreateVolumesFromSourceVolumeTest-2106260627 None] Lock "cinder-f9e59f5c-0fc6-48c1-a757-8d36d486fa4a-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:59 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 1073741824" returned: 0 in 0.539s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Flow 'volume_create_manager' (357625e3-b2f2-4429-8d50-3e770d33693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304312b4-c176-41a1-b3de-0b1ffb389505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304312b4-c176-41a1-b3de-0b1ffb389505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2015219299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee4d699-4561-46d2-97ea-f12fb8bdd688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b02258d2ec44c9599f0f3291283ba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:00Z,use_quota=True,user_id='d546e3780e30457b9b7c233b726064c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0594792-3ea6-4f14-aaa2-045570b61141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 Nov 05 08:41:59 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0594792-3ea6-4f14-aaa2-045570b61141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635bf254-b59a-4078-bbb0-d5ab74ddb63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635bf254-b59a-4078-bbb0-d5ab74ddb63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee4d699-4561-46d2-97ea-f12fb8bdd688', 'volume_name': 'volume-fee4d699-4561-46d2-97ea-f12fb8bdd688', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce1e12f-19d9-46be-9257-4254e3a96177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce1e12f-19d9-46be-9257-4254e3a96177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b14db0-41f4-48b0-b45a-be4909967ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Volume fee4d699-4561-46d2-97ea-f12fb8bdd688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee4d699-4561-46d2-97ea-f12fb8bdd688', 'volume_size': 1} Nov 05 08:41:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:00 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562" returned: 0 in 0.320s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.239s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2015219299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee4d699-4561-46d2-97ea-f12fb8bdd688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b02258d2ec44c9599f0f3291283ba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:00Z,use_quota=True,user_id='d546e3780e30457b9b7c233b726064c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Creating volume fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:00 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e5632a-8497-4e1a-bf5e-70bf982f4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311837c0-8644-44bd-b0ba-fe2d64321562', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:00 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 1073741824 Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4cb0ef-867a-4cea-a3e1-421fc8e72816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:00 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Volume volume-311837c0-8644-44bd-b0ba-fe2d64321562 (311837c0-8644-44bd-b0ba-fe2d64321562): created successfully Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4cb0ef-867a-4cea-a3e1-421fc8e72816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (777353b4-55ea-4dbe-8b9f-be262d4c0294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-aa13be27-9943-41d2-aa46-82214f0bd52a tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:00 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 1073741824" returned: 0 in 0.475s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:00 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b14db0-41f4-48b0-b45a-be4909967ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee4d699-4561-46d2-97ea-f12fb8bdd688', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58998050-0ee0-4f77-9834-cc6cdacba1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:01 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Volume volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 (fee4d699-4561-46d2-97ea-f12fb8bdd688): created successfully Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58998050-0ee0-4f77-9834-cc6cdacba1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Flow 'volume_create_manager' (357625e3-b2f2-4429-8d50-3e770d33693e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-885d39e8-8447-4f12-89c2-500c1d92a3aa tempest-VolumeDependencyTests-1971274092 None] Created volume successfully. Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot 27944a23-8830-429f-8333-c63f9d003d1f of volume 311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9dfb2-06d5-427d-9016-ac0545589189]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:01 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 Nov 05 08:42:01 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:01 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f 1G Nov 05 08:42:01 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:02 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f 1G" returned: 0 in 0.516s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311837c0-8644-44bd-b0ba-fe2d64321562 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311837c0-8644-44bd-b0ba-fe2d64321562 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f Nov 05 08:42:02 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Flow 'volume_create_manager' (2c21a882-ebf4-4bab-a8e2-4d029a105781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2719a0-481c-4283-8b77-5b7fcb22df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2719a0-481c-4283-8b77-5b7fcb22df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f92de9-ff70-49e8-8907-56fbc06ccac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59d0544202147d8923c3843b9018e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:02Z,use_quota=True,user_id='4adb1e43326b4c97bf8685006153b39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158fb873-cc12-4980-ba69-21fc70ea6956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158fb873-cc12-4980-ba69-21fc70ea6956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b5ea7-a4ac-410c-b8d2-fc4fea75e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b5ea7-a4ac-410c-b8d2-fc4fea75e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f92de9-ff70-49e8-8907-56fbc06ccac1', 'volume_name': 'volume-23f92de9-ff70-49e8-8907-56fbc06ccac1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7861a9fe-7165-4e91-a8e8-0c379b7b9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7861a9fe-7165-4e91-a8e8-0c379b7b9bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831668cf-1cb2-4edd-9afe-3668e521a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Volume 23f92de9-ff70-49e8-8907-56fbc06ccac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f92de9-ff70-49e8-8907-56fbc06ccac1', 'volume_size': 1} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:02 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311837c0-8644-44bd-b0ba-fe2d64321562 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f" returned: 0 in 0.302s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f is being set with open permissions: ugo+rw Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f Nov 05 08:42:02 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info Nov 05 08:42:02 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info is being set with open permissions: ugo+rw Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info Nov 05 08:42:03 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.info" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.185s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Creating offline snapshot 79f23f47-aad3-4d93-abb5-a247f64ee9d9 of volume fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-10cbc194-72c7-456c-a4f5-8ad5a734e99c tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d76869f-20df-47b6-8864-b8484117ac1d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:03 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 1G Nov 05 08:42:03 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:04 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 1G" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:04 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:04 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-27944a23-8830-429f-8333-c63f9d003d1f-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:04 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.326s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:04 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 is being set with open permissions: ugo+rw Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-27944a23-8830-429f-8333-c63f9d003d1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:04 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:04 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-27944a23-8830-429f-8333-c63f9d003d1f" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-27944a23-8830-429f-8333-c63f9d003d1f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot 27944a23-8830-429f-8333-c63f9d003d1f of volume 311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a218b2a-3501-4fb1-8ea1-f3037ca8704d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:04 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f Nov 05 08:42:04 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:04 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:04 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info Nov 05 08:42:04 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:04 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-311837c0-8644-44bd-b0ba-fe2d64321562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad6871-1b0c-4255-910f-e0b8ad061f2b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info" returned: 0 in 0.276s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info is being set with open permissions: ugo+rw Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info Nov 05 08:42:05 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 Nov 05 08:42:05 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.info" returned: 0 in 0.260s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.885s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f92de9-ff70-49e8-8907-56fbc06ccac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59d0544202147d8923c3843b9018e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:02Z,use_quota=True,user_id='4adb1e43326b4c97bf8685006153b39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Creating volume 23f92de9-ff70-49e8-8907-56fbc06ccac1 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:05 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 1073741824 Nov 05 08:42:05 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b732bf0c-bf32-44df-9f56-5506910ebca8 tempest-VolumeDependencyTests-1971274092 None] Create snapshot completed successfully Nov 05 08:42:05 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f Nov 05 08:42:05 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f" returned: 0 in 0.357s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f Nov 05 08:42:05 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 1073741824" returned: 0 in 0.452s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 Nov 05 08:42:05 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:06 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562.27944a23-8830-429f-8333-c63f9d003d1f" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-27944a23-8830-429f-8333-c63f9d003d1f" released by "_delete_snapshot" :: held 1.480s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" released by "delete_snapshot" :: held 1.503s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:06 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Created reservations ['7907049c-c837-41ab-978c-cda2de7ca686', '7838028a-0003-4354-9752-976709fc389e', 'ac339a70-93dc-4774-b878-49bb0cedda7b', '762ea436-1a0a-4204-a89f-0a278e2b980c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831668cf-1cb2-4edd-9afe-3668e521a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f92de9-ff70-49e8-8907-56fbc06ccac1', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd52bfb-ecae-4c37-a7e1-96435a8f8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:06 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Volume volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 (23f92de9-ff70-49e8-8907-56fbc06ccac1): created successfully Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd52bfb-ecae-4c37-a7e1-96435a8f8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Flow 'volume_create_manager' (2c21a882-ebf4-4bab-a8e2-4d029a105781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f419f0dc-0c96-42e0-b4d4-697473a9732e tempest-CinderUnicodeTest-1733325945 None] Created volume successfully. Nov 05 08:42:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4d044372-c562-4ba0-a50c-6af8c26834bf tempest-ProjectMemberTests-2076759849 None] Lock "cinder-27944a23-8830-429f-8333-c63f9d003d1f-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-311837c0-8644-44bd-b0ba-fe2d64321562-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-311837c0-8644-44bd-b0ba-fe2d64321562-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c2e07-3c53-4ae5-b1ea-b9d788bebaf9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Flow 'volume_create_manager' (48c18c93-79ce-43c3-9d54-4e91d8540133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421e78aa-6125-4d55-b0ef-043393703041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421e78aa-6125-4d55-b0ef-043393703041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-465421913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dc7dae-9d5a-432e-b794-2d7d0182ccfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b02258d2ec44c9599f0f3291283ba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79f23f47-aad3-4d93-abb5-a247f64ee9d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:07Z,use_quota=True,user_id='d546e3780e30457b9b7c233b726064c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8491c-6588-4de7-90f6-7bd7e82ac821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8491c-6588-4de7-90f6-7bd7e82ac821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 Nov 05 08:42:07 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289d7790-f878-437d-99d0-8ae2a3c5b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289d7790-f878-437d-99d0-8ae2a3c5b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0dc7dae-9d5a-432e-b794-2d7d0182ccfa', 'volume_name': 'volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa', 'volume_size': 1, 'snapshot_id': '79f23f47-aad3-4d93-abb5-a247f64ee9d9'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb1d828-5767-4fb3-840f-11b8f13d6a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb1d828-5767-4fb3-840f-11b8f13d6a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30c0088-fc8a-403b-9f69-7be9cb768275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Volume f0dc7dae-9d5a-432e-b794-2d7d0182ccfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa', 'volume_size': 1, 'snapshot_id': '79f23f47-aad3-4d93-abb5-a247f64ee9d9'} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Creating volume f0dc7dae-9d5a-432e-b794-2d7d0182ccfa from snapshot 79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] snapshot: 79f23f47-aad3-4d93-abb5-a247f64ee9d9, volume: f0dc7dae-9d5a-432e-b794-2d7d0182ccfa, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[90286fb2-99be-4b03-a192-de161e743d73]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Flow 'volume_create_manager' (9fe95f1a-f5d5-44dc-bef9-dcefd05fe27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cf0480-65ec-4e9a-92a0-792b01eb76e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cf0480-65ec-4e9a-92a0-792b01eb76e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1167662789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c59c5c-dd35-45cd-8392-c638613154a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59d0544202147d8923c3843b9018e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:07Z,use_quota=True,user_id='4adb1e43326b4c97bf8685006153b39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b139ad-86d1-40a9-944e-5c0de904f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b139ad-86d1-40a9-944e-5c0de904f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a395d0-5d55-4ba2-840d-329af02c1536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a395d0-5d55-4ba2-840d-329af02c1536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c59c5c-dd35-45cd-8392-c638613154a4', 'volume_name': 'volume-19c59c5c-dd35-45cd-8392-c638613154a4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdaf8a-0c00-4d81-a8aa-d5d6198f274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:07 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdaf8a-0c00-4d81-a8aa-d5d6198f274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9070e7a-105c-42ef-9df9-1ddbe1c6deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Volume 19c59c5c-dd35-45cd-8392-c638613154a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c59c5c-dd35-45cd-8392-c638613154a4', 'volume_size': 1} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562" returned: 0 in 0.439s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562 Nov 05 08:42:07 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee4d699-4561-46d2-97ea-f12fb8bdd688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232371d-7f20-4a87-9ab8-64853b3426e4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-311837c0-8644-44bd-b0ba-fe2d64321562" returned: 0 in 0.260s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-311837c0-8644-44bd-b0ba-fe2d64321562" released by "delete_volume" :: held 0.788s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Created reservations ['5b2f9b96-23a3-4e8d-b3fd-18c8d8d4a5c1', '332170ee-2616-4784-8bbb-394ed7084d26', '7be01169-84ca-45f1-afdb-fdfcb98feab4', 'ca8cfea4-8d94-4f96-a519-8ad7c032979e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:07 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:07 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:07 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.385s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:42:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:08 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.282s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:08 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa Nov 05 08:42:08 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:08 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-a4f16752-cfdf-4e43-b567-4a530450e229 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-311837c0-8644-44bd-b0ba-fe2d64321562-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (3485a2d7-d283-48e8-bbae-e180db8418ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e65dd99-aba8-4be2-b523-084f67b33110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e65dd99-aba8-4be2-b523-084f67b33110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18483086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c64f5a-521c-41e2-9b88-612c6366c9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:08Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680b3ed7-e388-42d8-97dd-8b31347b8a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680b3ed7-e388-42d8-97dd-8b31347b8a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf3e8ff-19f6-4684-b159-31e6e430b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf3e8ff-19f6-4684-b159-31e6e430b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c64f5a-521c-41e2-9b88-612c6366c9d5', 'volume_name': 'volume-68c64f5a-521c-41e2-9b88-612c6366c9d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887f8d31-3f1a-4729-a509-f362bfd55219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887f8d31-3f1a-4729-a509-f362bfd55219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d93615-b0c4-4a56-aa0c-078743291e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Volume 68c64f5a-521c-41e2-9b88-612c6366c9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c64f5a-521c-41e2-9b88-612c6366c9d5', 'volume_size': 1} Nov 05 08:42:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:14 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" returned: 0 in 6.105s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:42:14 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Converted 1024.00 MB image at 167.70 MB/s Nov 05 08:42:14 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa is being set with open permissions: ugo+rw Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:14 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa Nov 05 08:42:14 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:14 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" returned: 0 in 0.234s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" released by "_copy_volume_from_snapshot" :: held 7.203s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" released by "_create_volume_from_snapshot" :: held 7.278s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.300s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.036s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1167662789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c59c5c-dd35-45cd-8392-c638613154a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59d0544202147d8923c3843b9018e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:07Z,use_quota=True,user_id='4adb1e43326b4c97bf8685006153b39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Creating volume 19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:14 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:14 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 1073741824 Nov 05 08:42:14 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30c0088-fc8a-403b-9f69-7be9cb768275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa', 'volume_size': 1, 'snapshot_id': '79f23f47-aad3-4d93-abb5-a247f64ee9d9'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475fd52f-c46e-44a8-bc25-9d739f1cd4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:14 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Volume volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa (f0dc7dae-9d5a-432e-b794-2d7d0182ccfa): created successfully Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475fd52f-c46e-44a8-bc25-9d739f1cd4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Flow 'volume_create_manager' (48c18c93-79ce-43c3-9d54-4e91d8540133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9150dad9-548a-4f46-8b2b-f70b350770d1 tempest-VolumeDependencyTests-1971274092 None] Created volume successfully. Nov 05 08:42:14 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 1073741824" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:14 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 Nov 05 08:42:14 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:15 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.487s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18483086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c64f5a-521c-41e2-9b88-612c6366c9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:08Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Creating volume 68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:15 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=256,cinder:UPDATE=299,cinder:INSERT=78,cinder:DELETE=28 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9070e7a-105c-42ef-9df9-1ddbe1c6deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c59c5c-dd35-45cd-8392-c638613154a4', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:15 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 1073741824 Nov 05 08:42:15 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec4a3d-11a5-4dd0-95b5-2d0bfb46faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Volume volume-19c59c5c-dd35-45cd-8392-c638613154a4 (19c59c5c-dd35-45cd-8392-c638613154a4): created successfully Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec4a3d-11a5-4dd0-95b5-2d0bfb46faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Flow 'volume_create_manager' (9fe95f1a-f5d5-44dc-bef9-dcefd05fe27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d38b8663-a75f-4d75-b4ae-e07f53ad81fc tempest-CinderUnicodeTest-1733325945 None] Created volume successfully. Nov 05 08:42:15 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 1073741824" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=198,cinder:UPDATE=319,cinder:INSERT=86,cinder:DELETE=28 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:15 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 Nov 05 08:42:15 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-79f23f47-aad3-4d93-abb5-a247f64ee9d9-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-79f23f47-aad3-4d93-abb5-a247f64ee9d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Deleting offline snapshot 79f23f47-aad3-4d93-abb5-a247f64ee9d9 of volume fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] snapshot_file for this snap is: volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69d6c8e-766f-44ae-8ecc-e3e2d6427529]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:15 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:15 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:15 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d93615-b0c4-4a56-aa0c-078743291e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c64f5a-521c-41e2-9b88-612c6366c9d5', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316400f5-d565-4602-a4bf-3b8ec62b9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Volume volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 (68c64f5a-521c-41e2-9b88-612c6366c9d5): created successfully Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316400f5-d565-4602-a4bf-3b8ec62b9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (3485a2d7-d283-48e8-bbae-e180db8418ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-30cd1352-8c22-4a96-8bc8-c453f6f79337 tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:16 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.404s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee4d699-4561-46d2-97ea-f12fb8bdd688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7156c-5f6e-40db-8fe2-240369c06fd1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:16 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Creating offline snapshot d487fee4-95c6-4feb-bf23-75da9131b6bd of volume 19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f806f9bc-4adf-461f-a8b9-9b9c8b3db697]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 Nov 05 08:42:16 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:16 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.569s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:16 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:16 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4" returned: 0 in 0.379s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd 1G Nov 05 08:42:16 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9 Nov 05 08:42:17 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd 1G" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c59c5c-dd35-45cd-8392-c638613154a4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c59c5c-dd35-45cd-8392-c638613154a4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd Nov 05 08:42:17 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688.79f23f47-aad3-4d93-abb5-a247f64ee9d9" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-79f23f47-aad3-4d93-abb5-a247f64ee9d9" released by "_delete_snapshot" :: held 1.723s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" released by "delete_snapshot" :: held 1.752s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Created reservations ['35d245e6-8920-4caf-a0e9-484e722c4b73', 'c01d5acb-af68-4a86-b688-c7f505e8a210', '67f3c298-cb8d-4ba0-9e03-0cd7550de775', 'a1bedafd-6c4b-4cb3-9eae-cd5daec1dfde'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:17 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Delete snapshot completed successfully. Nov 05 08:42:17 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c59c5c-dd35-45cd-8392-c638613154a4 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd" returned: 0 in 0.306s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-af5e84a9-c4d6-4ece-b4c3-414f14922711 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-79f23f47-aad3-4d93-abb5-a247f64ee9d9-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:17 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd is being set with open permissions: ugo+rw Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd Nov 05 08:42:17 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-fee4d699-4561-46d2-97ea-f12fb8bdd688-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-fee4d699-4561-46d2-97ea-f12fb8bdd688-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info Nov 05 08:42:17 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658cce5-af9a-4a2b-a187-69d8dd008f60]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:17 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info is being set with open permissions: ugo+rw Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info Nov 05 08:42:18 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688 Nov 05 08:42:18 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.info" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.983s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot 4a6d4508-a6e0-47fd-a8e2-94d3ea683457 of volume 68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-03eaac86-e1b5-4efe-8479-26d037329b7f tempest-CinderUnicodeTest-1733325945 None] Create snapshot completed successfully Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[00456a37-40e3-4230-aed9-65006c7da7d3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 Nov 05 08:42:18 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-fee4d699-4561-46d2-97ea-f12fb8bdd688" returned: 0 in 0.275s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-fee4d699-4561-46d2-97ea-f12fb8bdd688" released by "delete_volume" :: held 0.704s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Created reservations ['4c2e8421-65f1-4782-8129-90fe71c61895', 'd378e565-cbc2-463a-afca-d14a772294a6', '2258a4cc-6edd-4056-a9ac-da0d2cfde048', 'e8a38e32-b447-4cd6-b013-149b70dd5ce8'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:18 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 1G Nov 05 08:42:18 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.262s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Deleted volume successfully. Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0bc90d9f-eb6f-4082-84a6-b4d444e38eb7 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-fee4d699-4561-46d2-97ea-f12fb8bdd688-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b088ec-8486-4931-8db5-8e09c4db7a1f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa Nov 05 08:42:19 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 1G" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 Nov 05 08:42:19 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" returned: 0 in 0.444s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-d487fee4-95c6-4feb-bf23-75da9131b6bd-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa Nov 05 08:42:19 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457" returned: 0 in 0.337s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 is being set with open permissions: ugo+rw Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-d487fee4-95c6-4feb-bf23-75da9131b6bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 Nov 05 08:42:19 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-quobyte-d487fee4-95c6-4feb-bf23-75da9131b6bd" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-d487fee4-95c6-4feb-bf23-75da9131b6bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Deleting offline snapshot d487fee4-95c6-4feb-bf23-75da9131b6bd of volume 19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] snapshot_file for this snap is: volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471cbb1-cce9-4793-8ee0-4da065086b85]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd Nov 05 08:42:19 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-quobyte-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa" released by "delete_volume" :: held 0.758s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Created reservations ['60bc25f3-58d0-48fa-a2cb-bc0189a48249', '081a0179-0560-45dc-9a0c-a414aa3e8c4d', 'c56438b5-8d98-4ae1-998c-772d7e75adb0', '0f8950a1-3da9-4562-b477-0d9f7ca6dedf'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info Nov 05 08:42:19 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c59c5c-dd35-45cd-8392-c638613154a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71274d7-410a-406e-883f-e06447a33e38]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info is being set with open permissions: ugo+rw Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info Nov 05 08:42:20 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 Nov 05 08:42:20 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.320s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Deleted volume successfully. Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f245a828-a93d-4d85-a70d-3ebe639fcd94 tempest-VolumeDependencyTests-1971274092 None] Lock "cinder-f0dc7dae-9d5a-432e-b794-2d7d0182ccfa-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:20 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.info" returned: 0 in 0.311s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:20 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4" returned: 0 in 0.418s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-db64e877-9fa2-4eef-8c9a-cf17b28be004 tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:20 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd Nov 05 08:42:20 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd Nov 05 08:42:20 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:21 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4.d487fee4-95c6-4feb-bf23-75da9131b6bd" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-d487fee4-95c6-4feb-bf23-75da9131b6bd" released by "_delete_snapshot" :: held 1.637s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" released by "delete_snapshot" :: held 1.664s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Created reservations ['dfe37831-4de3-4b42-a66c-163af1f4ac8e', 'e71afae3-67e3-4a19-ac27-844def5690a4', 'fa984aaa-b111-4580-9936-f9877f68460b', '04a7e8b0-5f70-4175-89d4-873a0683eaf7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Delete snapshot completed successfully. Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f19160da-f84f-493b-92a1-0123b3192139 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-d487fee4-95c6-4feb-bf23-75da9131b6bd-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-4a6d4508-a6e0-47fd-a8e2-94d3ea683457-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-4a6d4508-a6e0-47fd-a8e2-94d3ea683457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-4a6d4508-a6e0-47fd-a8e2-94d3ea683457" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-4a6d4508-a6e0-47fd-a8e2-94d3ea683457" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot 4a6d4508-a6e0-47fd-a8e2-94d3ea683457 of volume 68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074f5b3-3ab7-49e6-83a5-49e7ae3e92b4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-19c59c5c-dd35-45cd-8392-c638613154a4-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-19c59c5c-dd35-45cd-8392-c638613154a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 Nov 05 08:42:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[db71d0ac-4803-429c-8da7-64d86dc08e43]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 Nov 05 08:42:21 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457" returned: 0 in 0.435s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c64f5a-521c-41e2-9b88-612c6366c9d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8191f58-cef8-4297-bc78-ef110e006654]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4 Nov 05 08:42:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 Nov 05 08:42:22 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-19c59c5c-dd35-45cd-8392-c638613154a4" returned: 0 in 0.291s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-19c59c5c-dd35-45cd-8392-c638613154a4" released by "delete_volume" :: held 0.761s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:22 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 Nov 05 08:42:22 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Created reservations ['fbc5ef5f-1d89-469a-8e5e-9adbb6ffa0cc', 'b9935cf2-0669-4623-bbdf-8c91d44a0348', '60e6d8e5-6b08-4709-861f-6c730326c927', '5abb2199-802d-4dbd-97bc-20945185fe43'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:22 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-23f92de9-ff70-49e8-8907-56fbc06ccac1-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-23f92de9-ff70-49e8-8907-56fbc06ccac1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:22 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "cinder-quobyte-23f92de9-ff70-49e8-8907-56fbc06ccac1" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457" returned: 0 in 0.486s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-23f92de9-ff70-49e8-8907-56fbc06ccac1" acquired by "delete_volume" :: waited 0.032s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:23 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457 Nov 05 08:42:23 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Deleted volume successfully. Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-10cd8d4b-6f20-45a1-ab7f-b90c99f3b1f0 tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-19c59c5c-dd35-45cd-8392-c638613154a4-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3dcead-891b-4c4b-8b6a-65db013f2c0f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 Nov 05 08:42:23 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5.4a6d4508-a6e0-47fd-a8e2-94d3ea683457" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-4a6d4508-a6e0-47fd-a8e2-94d3ea683457" released by "_delete_snapshot" :: held 1.692s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" released by "delete_snapshot" :: held 1.728s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Created reservations ['1b230976-ab2e-47ac-b812-b10070f9a8c6', 'b0934323-73c4-4607-bfdb-333e93cc61ab', 'd6e3aa8f-6d44-428f-951f-5526e2df9a3c', '1acf3562-f1df-4b20-bef8-af579b750baa'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:23 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5542d325-747c-4be6-98d6-a65ab9bc6aa5 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-4a6d4508-a6e0-47fd-a8e2-94d3ea683457-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1 Nov 05 08:42:23 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-23f92de9-ff70-49e8-8907-56fbc06ccac1" returned: 0 in 0.252s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-quobyte-23f92de9-ff70-49e8-8907-56fbc06ccac1" released by "delete_volume" :: held 0.713s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-68c64f5a-521c-41e2-9b88-612c6366c9d5-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-68c64f5a-521c-41e2-9b88-612c6366c9d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Created reservations ['570cda07-e596-4883-9238-804ee77b1838', 'e53c5914-4cc8-4443-be06-09f08a9238c2', '35e343d1-5a88-4d26-a1d9-333ad9f46af0', '72fdbd56-a74a-467a-a18f-6b6e3211776a'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-7f46b24a-c45e-407a-ac1d-9a05f2f123d5 tempest-ProjectAdminTests-925888494 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87101) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f0dab-d4f0-4514-b707-9658169f216c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:23 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 Nov 05 08:42:23 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:24 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.322s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Deleted volume successfully. Nov 05 08:42:24 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5" returned: 0 in 0.426s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-4e442402-e97a-4dba-b9d9-d5ed96c0784b tempest-CinderUnicodeTest-1733325945 None] Lock "cinder-23f92de9-ff70-49e8-8907-56fbc06ccac1-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:24 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5 Nov 05 08:42:24 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:24 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-68c64f5a-521c-41e2-9b88-612c6366c9d5" returned: 0 in 0.307s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-68c64f5a-521c-41e2-9b88-612c6366c9d5" released by "delete_volume" :: held 0.810s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Created reservations ['40c2af8d-8a89-42fc-9eb7-2269b35ba08f', 'fc4cb24c-1bb8-40cd-a713-9a9bdd08ca1e', '0cc508a0-f35b-4868-b378-bf77f03c6284', '0bb822b9-ef70-4925-b80d-986417cf1b44'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:24 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:24 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:25 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.319s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:25 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-bc7018c0-7a44-4795-b897-ffa85ed89886 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-68c64f5a-521c-41e2-9b88-612c6366c9d5-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (0c892b8d-44ae-49c3-84bf-f6755c68175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b79650-c884-4688-837f-0cc797d20805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b79650-c884-4688-837f-0cc797d20805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996039816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9489bd-288e-4669-9ed4-695da93a39c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002126e3-444e-4930-b492-1ff8cd96ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002126e3-444e-4930-b492-1ff8cd96ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1963541-97b7-45f2-b6ec-80612dfaf2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1963541-97b7-45f2-b6ec-80612dfaf2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9489bd-288e-4669-9ed4-695da93a39c9', 'volume_name': 'volume-ed9489bd-288e-4669-9ed4-695da93a39c9', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1654a-978a-412d-9917-d3c58f7f7eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1654a-978a-412d-9917-d3c58f7f7eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7f1a57-e055-4dfd-bd29-460639695575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Volume ed9489bd-288e-4669-9ed4-695da93a39c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9489bd-288e-4669-9ed4-695da93a39c9', 'volume_size': 1} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996039816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9489bd-288e-4669-9ed4-695da93a39c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Creating volume ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:25 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:25 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 1073741824 Nov 05 08:42:25 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:26 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 1073741824" returned: 0 in 0.557s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:26 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 Nov 05 08:42:26 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:26 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9" returned: 0 in 0.305s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7f1a57-e055-4dfd-bd29-460639695575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9489bd-288e-4669-9ed4-695da93a39c9', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c06068-7847-4f61-b59f-953a3f5f3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:26 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Volume volume-ed9489bd-288e-4669-9ed4-695da93a39c9 (ed9489bd-288e-4669-9ed4-695da93a39c9): created successfully Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c06068-7847-4f61-b59f-953a3f5f3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (0c892b8d-44ae-49c3-84bf-f6755c68175b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-11a8e4fc-c822-4c18-9d5c-2bc675c57f36 tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot d0f29416-b829-466f-92b3-4f8cc99ff143 of volume ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:27 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a76e45-0c4a-4828-b914-6797da43adff]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:27 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 Nov 05 08:42:27 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 1G Nov 05 08:42:28 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 1G" returned: 0 in 0.470s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9489bd-288e-4669-9ed4-695da93a39c9 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9489bd-288e-4669-9ed4-695da93a39c9 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 Nov 05 08:42:28 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9489bd-288e-4669-9ed4-695da93a39c9 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143" returned: 0 in 0.356s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 is being set with open permissions: ugo+rw Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 Nov 05 08:42:29 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143" returned: 0 in 0.264s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info Nov 05 08:42:29 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info is being set with open permissions: ugo+rw Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info Nov 05 08:42:29 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.info" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:29 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9d9ab8a7-7a22-41ff-b1bc-b072b0e72369 tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-d0f29416-b829-466f-92b3-4f8cc99ff143-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d0f29416-b829-466f-92b3-4f8cc99ff143-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-d0f29416-b829-466f-92b3-4f8cc99ff143" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d0f29416-b829-466f-92b3-4f8cc99ff143" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot d0f29416-b829-466f-92b3-4f8cc99ff143 of volume ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c2620-ec6d-4b3a-a6ff-e94b63e21557]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 Nov 05 08:42:31 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed9489bd-288e-4669-9ed4-695da93a39c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe33303-260a-47cb-8d0a-35f559705210]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 Nov 05 08:42:31 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 Nov 05 08:42:31 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143" returned: 0 in 0.417s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143 Nov 05 08:42:32 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9.d0f29416-b829-466f-92b3-4f8cc99ff143" returned: 0 in 0.283s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d0f29416-b829-466f-92b3-4f8cc99ff143" released by "_delete_snapshot" :: held 1.632s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" released by "delete_snapshot" :: held 1.663s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Created reservations ['6e5d7f25-6bb2-41ed-a587-80de298baa77', 'd547cf07-b866-430f-b09a-4665f22dd891', 'e3b981d9-249a-4498-924d-d10c28af4e83', '4a10411f-6bba-45e0-b6c2-7ea282216330'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:32 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:32 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-b78b35c5-0f90-4664-ad1e-da143b912ef4 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d0f29416-b829-466f-92b3-4f8cc99ff143-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-ed9489bd-288e-4669-9ed4-695da93a39c9-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "cinder-ed9489bd-288e-4669-9ed4-695da93a39c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc3c124-b35a-46cc-829c-c94980d07e04]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 Nov 05 08:42:33 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9" returned: 0 in 0.435s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9 Nov 05 08:42:33 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ed9489bd-288e-4669-9ed4-695da93a39c9" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ed9489bd-288e-4669-9ed4-695da93a39c9" released by "delete_volume" :: held 0.833s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Created reservations ['d2801dbd-b52c-42eb-9e1b-2f24ddef76e6', 'e3af5247-8a1c-49be-a57e-5f85407bf806', '7f6370e6-7511-489c-a820-8e451dded2f7', '6be4e1a5-0cb4-44d6-85dc-29ae1bd2476d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:34 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.315s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-284e2a66-4e5b-431c-891f-074c5ba11b0a tempest-ProjectMemberTests-2076759849 None] Lock "cinder-ed9489bd-288e-4669-9ed4-695da93a39c9-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (f64d2f2b-21bd-4814-9d4e-8e1e33dc187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591c7d09-7818-40e0-91d6-2322ab85351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591c7d09-7818-40e0-91d6-2322ab85351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606101494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5967eb-0b24-436c-b3d1-ed028eb18bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:35Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69df355-cfa4-4d52-8691-31cb323f9241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69df355-cfa4-4d52-8691-31cb323f9241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5500e2b-614a-4eff-81af-ac01c599bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5500e2b-614a-4eff-81af-ac01c599bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5967eb-0b24-436c-b3d1-ed028eb18bf3', 'volume_name': 'volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b676be-bdc6-40ea-abce-6c23522c47d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b676be-bdc6-40ea-abce-6c23522c47d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d981c31b-e896-400e-8c87-2f1675ac8194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Volume ea5967eb-0b24-436c-b3d1-ed028eb18bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3', 'volume_size': 1} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606101494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5967eb-0b24-436c-b3d1-ed028eb18bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:35Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Creating volume ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:35 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:35 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 1073741824 Nov 05 08:42:35 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:35 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 1073741824" returned: 0 in 0.541s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:35 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 Nov 05 08:42:35 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" returned: 0 in 0.350s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d981c31b-e896-400e-8c87-2f1675ac8194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06942875-10e6-4c95-85fc-13eba3bd1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:36 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Volume volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 (ea5967eb-0b24-436c-b3d1-ed028eb18bf3): created successfully Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06942875-10e6-4c95-85fc-13eba3bd1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:36 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (f64d2f2b-21bd-4814-9d4e-8e1e33dc187b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9fd2a923-812e-4889-a77e-17e05c835446 tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot fa820583-5554-4d2e-8a02-58e7f63a0480 of volume ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[45538c01-744e-4103-ab56-cff028b48f6a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 Nov 05 08:42:37 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 1G Nov 05 08:42:37 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (5056a471-8ca6-468e-942b-a86537c76d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8957fb-c4bc-47f3-ad3b-47b66e4e5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8957fb-c4bc-47f3-ad3b-47b66e4e5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325853832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e514b449-551c-42bf-add3-05cc344cf504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1293577-2920-4d18-a527-9e9fc32e9586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1293577-2920-4d18-a527-9e9fc32e9586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1051ebf0-ac62-4b02-9265-cd0edd31cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1051ebf0-ac62-4b02-9265-cd0edd31cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e514b449-551c-42bf-add3-05cc344cf504', 'volume_name': 'volume-e514b449-551c-42bf-add3-05cc344cf504', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59b7471-d8bd-4ecb-9955-71ae3235feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59b7471-d8bd-4ecb-9955-71ae3235feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b9c3cc-6b6b-414d-9060-8e8ff5e2bcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Volume e514b449-551c-42bf-add3-05cc344cf504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e514b449-551c-42bf-add3-05cc344cf504', 'volume_size': 1} Nov 05 08:42:37 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:38 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 1G" returned: 0 in 0.399s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 Nov 05 08:42:38 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480" returned: 0 in 0.285s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 is being set with open permissions: ugo+rw Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 Nov 05 08:42:38 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480" returned: 0 in 0.237s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info Nov 05 08:42:38 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info is being set with open permissions: ugo+rw Nov 05 08:42:38 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info Nov 05 08:42:38 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.info" returned: 0 in 0.251s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325853832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e514b449-551c-42bf-add3-05cc344cf504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Creating volume e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:39 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 1073741824 Nov 05 08:42:39 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9d90009e-8e99-4dd5-b4c1-ab82a531628c tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-fa820583-5554-4d2e-8a02-58e7f63a0480-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-fa820583-5554-4d2e-8a02-58e7f63a0480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-fa820583-5554-4d2e-8a02-58e7f63a0480" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-fa820583-5554-4d2e-8a02-58e7f63a0480" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot fa820583-5554-4d2e-8a02-58e7f63a0480 of volume ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d518f9a-9e5c-48cd-a1ca-056becbd7dce]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 Nov 05 08:42:39 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 1073741824" returned: 0 in 0.486s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 Nov 05 08:42:39 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1384015-e525-4f26-88f0-e1b502a95de4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b9c3cc-6b6b-414d-9060-8e8ff5e2bcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e514b449-551c-42bf-add3-05cc344cf504', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8da516-341c-4da5-bce3-e6de74d5f8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:39 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Volume volume-e514b449-551c-42bf-add3-05cc344cf504 (e514b449-551c-42bf-add3-05cc344cf504): created successfully Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8da516-341c-4da5-bce3-e6de74d5f8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:39 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (5056a471-8ca6-468e-942b-a86537c76d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:39 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a2a99635-48b1-456a-9a9f-956f2e03c4a3 tempest-ProjectReaderTests-45298514 None] Created volume successfully. Nov 05 08:42:40 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 Nov 05 08:42:40 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" returned: 0 in 0.364s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:40 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 Nov 05 08:42:40 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480" returned: 0 in 0.327s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:40 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480 Nov 05 08:42:40 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3.fa820583-5554-4d2e-8a02-58e7f63a0480" returned: 0 in 0.247s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-fa820583-5554-4d2e-8a02-58e7f63a0480" released by "_delete_snapshot" :: held 1.402s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" released by "delete_snapshot" :: held 1.431s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:40 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Created reservations ['a327daa9-11d1-4548-b6ea-a0b2f902c1de', 'dd5f8559-e795-4abb-a4dc-f14dab078715', 'f4cd2b9c-ff33-455b-81d4-7ddc4b52a243', 'e4e3eb57-141f-436a-b8a2-08aabea6b0c7'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:41 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-083adf4d-5a77-4cdb-babd-d7fd9592662f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-fa820583-5554-4d2e-8a02-58e7f63a0480-delete_snapshot" released by "delete_snapshot" :: held 1.596s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Creating offline snapshot 5382c6ae-1367-41c0-b1c6-f0756bfdd94f of volume e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ecce6b-692b-43bf-9afd-9cdc49d87591]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 Nov 05 08:42:41 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f 1G Nov 05 08:42:41 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-ea5967eb-0b24-436c-b3d1-ed028eb18bf3-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "cinder-ea5967eb-0b24-436c-b3d1-ed028eb18bf3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbaa38d-e08a-43c7-8df8-44b6c9930bdd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 Nov 05 08:42:41 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f 1G" returned: 0 in 0.441s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e514b449-551c-42bf-add3-05cc344cf504 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e514b449-551c-42bf-add3-05cc344cf504 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f Nov 05 08:42:41 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" returned: 0 in 0.389s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3 Nov 05 08:42:42 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e514b449-551c-42bf-add3-05cc344cf504 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f" returned: 0 in 0.303s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f is being set with open permissions: ugo+rw Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f Nov 05 08:42:42 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" returned: 0 in 0.258s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-ea5967eb-0b24-436c-b3d1-ed028eb18bf3" released by "delete_volume" :: held 0.709s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Created reservations ['343d714a-987f-4cc0-aabd-0d0984ac4e68', '7fe6be97-88e8-4d8f-be5b-885e156e2ada', 'f152b4e1-f647-4631-a6ec-97278fff69f7', 'd2103812-1d4c-4b5a-8f0c-afc1b0a38351'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:42 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info Nov 05 08:42:42 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:42 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info is being set with open permissions: ugo+rw Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info Nov 05 08:42:42 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.259s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:42 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:42 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-f1dabdb8-c4fa-4052-98b7-68fd0900406e tempest-ProjectMemberTests-2076759849 None] Lock "cinder-ea5967eb-0b24-436c-b3d1-ed028eb18bf3-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:43 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.info" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:43 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d6148e93-dc9f-4fbf-9c0f-51fe27303007 tempest-ProjectReaderTests-45298514 None] Create snapshot completed successfully Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (4d7e31a8-dc26-4fe3-a44a-6c4af1dbb0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3ab045-0cb7-4507-bc7f-dd6213638c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3ab045-0cb7-4507-bc7f-dd6213638c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834002436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b2692e-4b17-4824-ad58-6bc64e9a9c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:43Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de85792-6eb3-4cf5-8bc5-d0cf08ce3fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de85792-6eb3-4cf5-8bc5-d0cf08ce3fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf348c7-df54-430a-aefa-9ccd49eb7b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf348c7-df54-430a-aefa-9ccd49eb7b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b2692e-4b17-4824-ad58-6bc64e9a9c6f', 'volume_name': 'volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715e4886-dd0b-4177-b499-85972554a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715e4886-dd0b-4177-b499-85972554a553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb83b45-c4a5-4b34-95da-bdf4ec343995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Volume 56b2692e-4b17-4824-ad58-6bc64e9a9c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f', 'volume_size': 1} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834002436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b2692e-4b17-4824-ad58-6bc64e9a9c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:43Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Creating volume 56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:43 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-5382c6ae-1367-41c0-b1c6-f0756bfdd94f-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f 1073741824 Nov 05 08:42:43 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-5382c6ae-1367-41c0-b1c6-f0756bfdd94f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-5382c6ae-1367-41c0-b1c6-f0756bfdd94f" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-5382c6ae-1367-41c0-b1c6-f0756bfdd94f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Deleting offline snapshot 5382c6ae-1367-41c0-b1c6-f0756bfdd94f of volume e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] snapshot_file for this snap is: volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13027f-dc64-45a5-b8ff-564bd6e6f080]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f Nov 05 08:42:43 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f 1073741824" returned: 0 in 0.424s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f" returned: 0 in 0.375s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e514b449-551c-42bf-add3-05cc344cf504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:43 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f Nov 05 08:42:43 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[42743592-6201-40fb-8e4e-39fc8eac825f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:43 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 Nov 05 08:42:43 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" returned: 0 in 0.265s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb83b45-c4a5-4b34-95da-bdf4ec343995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e313743-e55a-4281-9286-593b31441bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:44 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Volume volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f (56b2692e-4b17-4824-ad58-6bc64e9a9c6f): created successfully Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e313743-e55a-4281-9286-593b31441bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (4d7e31a8-dc26-4fe3-a44a-6c4af1dbb0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:44 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f2e6e1d7-b80e-4f90-93d8-4a315eea81c1 tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:44 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f Nov 05 08:42:44 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot 841c8eb3-e0a9-418d-a404-edf2a6dc5595 of volume 56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b6f43-cca1-48f0-8b38-d6c405241dd8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f" returned: 0 in 0.358s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f Nov 05 08:42:44 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f Nov 05 08:42:44 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504.5382c6ae-1367-41c0-b1c6-f0756bfdd94f" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" returned: 0 in 0.387s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-5382c6ae-1367-41c0-b1c6-f0756bfdd94f" released by "_delete_snapshot" :: held 1.487s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" released by "delete_snapshot" :: held 1.511s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:44 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 1G Nov 05 08:42:44 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Created reservations ['6b4941de-b71e-444d-a60e-fc62bb52c5e1', 'e61992a5-1158-4fa9-81d5-be13bc751b8d', 'a0db1e0b-ae6a-426b-a6a3-7dfc1c516c05', '2f6f81ac-1e18-46ca-b2ec-24c51bd383f5'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:45 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Delete snapshot completed successfully. Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9a80cec7-887f-4840-8716-14189a42a054 tempest-ProjectReaderTests-45298514 None] Lock "cinder-5382c6ae-1367-41c0-b1c6-f0756bfdd94f-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:45 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 1G" returned: 0 in 0.397s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 Nov 05 08:42:45 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-e514b449-551c-42bf-add3-05cc344cf504-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "cinder-e514b449-551c-42bf-add3-05cc344cf504-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595" returned: 0 in 0.338s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 is being set with open permissions: ugo+rw Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc39776-147a-42c6-a41f-43324ffa43df]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 Nov 05 08:42:45 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 Nov 05 08:42:45 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595" returned: 0 in 0.243s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info Nov 05 08:42:45 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504" returned: 0 in 0.372s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504 Nov 05 08:42:46 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info" returned: 0 in 0.271s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info is being set with open permissions: ugo+rw Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info Nov 05 08:42:46 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-e514b449-551c-42bf-add3-05cc344cf504" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-e514b449-551c-42bf-add3-05cc344cf504" released by "delete_volume" :: held 0.702s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Created reservations ['4118603e-049c-4913-b6f4-6883f4b2ffbf', '976415bc-b631-4111-b502-dbac3e4a6feb', '4d6a6d56-9e28-461f-afec-7593be331b22', '8ead4d3a-5a08-4113-bc3a-fd4c521e5e66'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:46 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.info" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:46 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-21c65044-3323-4249-be80-949d18d3f21c tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-841c8eb3-e0a9-418d-a404-edf2a6dc5595-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-841c8eb3-e0a9-418d-a404-edf2a6dc5595-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-841c8eb3-e0a9-418d-a404-edf2a6dc5595" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:46 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-841c8eb3-e0a9-418d-a404-edf2a6dc5595" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot 841c8eb3-e0a9-418d-a404-edf2a6dc5595 of volume 56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.297s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:46 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Deleted volume successfully. Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f69314-c80a-4a73-a933-c0c9386cf7e2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-21227992-3383-4136-9dcb-ca14a17c479e tempest-ProjectReaderTests-45298514 None] Lock "cinder-e514b449-551c-42bf-add3-05cc344cf504-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:46 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 Nov 05 08:42:46 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595" returned: 0 in 0.434s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab868f-8f3d-483a-9acd-4e02454e409e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (528bad25-e0fa-4535-8c7b-2d32702edc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877845cf-1064-4b44-ae2b-d244e7365c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877845cf-1064-4b44-ae2b-d244e7365c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839057726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f11201a-5397-443a-b09f-6e2d28d7fb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:47Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7694170b-e774-440e-9e4c-4b6eb4117881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7694170b-e774-440e-9e4c-4b6eb4117881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0e2a1-49bb-4010-8877-174107958d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0e2a1-49bb-4010-8877-174107958d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f11201a-5397-443a-b09f-6e2d28d7fb8f', 'volume_name': 'volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1faadc8-791c-4f0a-b2e9-d30fb563e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f Nov 05 08:42:47 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1faadc8-791c-4f0a-b2e9-d30fb563e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe370937-e4bd-463e-aa22-298700cfc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Volume 4f11201a-5397-443a-b09f-6e2d28d7fb8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f', 'volume_size': 1} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839057726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f11201a-5397-443a-b09f-6e2d28d7fb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:47Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Creating volume 4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:47 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f 1073741824 Nov 05 08:42:47 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" returned: 0 in 0.391s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 Nov 05 08:42:47 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f 1073741824" returned: 0 in 0.447s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f Nov 05 08:42:47 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:48 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595 Nov 05 08:42:48 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:48 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe370937-e4bd-463e-aa22-298700cfc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af40cd3b-cf3b-4db7-a628-3b87d76eacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:48 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Volume volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f (4f11201a-5397-443a-b09f-6e2d28d7fb8f): created successfully Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af40cd3b-cf3b-4db7-a628-3b87d76eacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (528bad25-e0fa-4535-8c7b-2d32702edc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-544321d5-b5d9-4d33-bfb6-8d03cac63277 tempest-ProjectReaderTests-45298514 None] Created volume successfully. Nov 05 08:42:48 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f.841c8eb3-e0a9-418d-a404-edf2a6dc5595" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-841c8eb3-e0a9-418d-a404-edf2a6dc5595" released by "_delete_snapshot" :: held 1.592s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" released by "delete_snapshot" :: held 1.615s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Created reservations ['285abf10-f206-4c18-abf4-a7cfc7648edd', '371d63c6-0542-4df8-a452-f9ddd447f1b5', '031cbe5e-d96c-4d79-b8da-6890b8e2a119', 'feb67df7-faf0-4936-b7f5-a44cc52d29ac'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:48 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-75466c64-647e-4e0c-8474-be2e7baf36d1 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-841c8eb3-e0a9-418d-a404-edf2a6dc5595-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:48 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:48 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-56b2692e-4b17-4824-ad58-6bc64e9a9c6f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-56b2692e-4b17-4824-ad58-6bc64e9a9c6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:48 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.261s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" acquired by "delete_volume" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7a6ccd-0364-4146-b6f8-5ba7d579a638]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f Nov 05 08:42:49 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" returned: 0 in 0.364s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f Nov 05 08:42:49 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Creating offline snapshot 37a87b0f-975a-4d15-b13b-26a7adda004b of volume 4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59e902-3fae-4512-a4f2-3ce4452f4273]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-56b2692e-4b17-4824-ad58-6bc64e9a9c6f" released by "delete_volume" :: held 0.689s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Created reservations ['a4b29b2e-c52f-4767-ae1b-14c82e4071d6', '207084b8-42e0-42dd-902c-8c93a82a8a9d', '8957954d-4248-4710-8309-8c1835d5321c', '9335f16d-ef61-45e0-ae88-b1e44eda2407'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:49 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f Nov 05 08:42:49 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:49 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f" returned: 0 in 0.367s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b 1G Nov 05 08:42:49 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.273s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:49 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:49 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-0ec88bc1-b932-4c65-af52-c9fb0e735e86 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-56b2692e-4b17-4824-ad58-6bc64e9a9c6f-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:50 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b 1G" returned: 0 in 0.492s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:50 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b Nov 05 08:42:50 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (9aa12cd7-679f-41b5-9ab1-3e6a4ffa712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2be3c0-d88d-48d5-9fb3-0d75b77e2302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2be3c0-d88d-48d5-9fb3-0d75b77e2302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995559571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d234ad-491a-4d92-abac-d82982702f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:50Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8d3764-fda5-4a30-a964-daa7da57229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8d3764-fda5-4a30-a964-daa7da57229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5415b61-ecb1-47c7-884b-6a1633c8d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5415b61-ecb1-47c7-884b-6a1633c8d15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d234ad-491a-4d92-abac-d82982702f89', 'volume_name': 'volume-36d234ad-491a-4d92-abac-d82982702f89', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c952f0c-910f-493f-bc06-bdbdcaecaf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c952f0c-910f-493f-bc06-bdbdcaecaf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562278e3-b306-49d8-91e4-7a34c2682373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:50 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Volume 36d234ad-491a-4d92-abac-d82982702f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d234ad-491a-4d92-abac-d82982702f89', 'volume_size': 1} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:50 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b" returned: 0 in 0.292s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b is being set with open permissions: ugo+rw Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:50 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b Nov 05 08:42:50 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:50 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:50 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info Nov 05 08:42:50 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info is being set with open permissions: ugo+rw Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info Nov 05 08:42:51 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.info" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995559571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d234ad-491a-4d92-abac-d82982702f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:50Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Creating volume 36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:51 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 1073741824 Nov 05 08:42:51 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-c6d0bd02-0f12-4152-ab59-de53bdf1c732 tempest-ProjectReaderTests-45298514 None] Create snapshot completed successfully Nov 05 08:42:51 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 1073741824" returned: 0 in 0.406s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 Nov 05 08:42:51 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:52 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562278e3-b306-49d8-91e4-7a34c2682373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d234ad-491a-4d92-abac-d82982702f89', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15e9c08-8421-4b44-8d31-d88cc3984a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Volume volume-36d234ad-491a-4d92-abac-d82982702f89 (36d234ad-491a-4d92-abac-d82982702f89): created successfully Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15e9c08-8421-4b44-8d31-d88cc3984a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (9aa12cd7-679f-41b5-9ab1-3e6a4ffa712d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:52 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-369ac32c-cd89-43f2-89c6-c414d502cdfd tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-37a87b0f-975a-4d15-b13b-26a7adda004b-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot 596b445d-6d18-4ef1-b37e-e77ea9f3e25b of volume 36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce974df-7153-4f1a-b227-b565774b0133]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-37a87b0f-975a-4d15-b13b-26a7adda004b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-37a87b0f-975a-4d15-b13b-26a7adda004b" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-37a87b0f-975a-4d15-b13b-26a7adda004b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Deleting offline snapshot 37a87b0f-975a-4d15-b13b-26a7adda004b of volume 4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] snapshot_file for this snap is: volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed1204-4cc8-4939-9a94-3e203d2936dc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:52 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:52 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 Nov 05 08:42:52 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:52 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b Nov 05 08:42:52 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89" returned: 0 in 0.378s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b 1G Nov 05 08:42:53 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b" returned: 0 in 0.388s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83db0e1-b646-4245-9982-aa0ef2498923]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f Nov 05 08:42:53 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b 1G" returned: 0 in 0.400s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d234ad-491a-4d92-abac-d82982702f89 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d234ad-491a-4d92-abac-d82982702f89 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b Nov 05 08:42:53 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f" returned: 0 in 0.379s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b Nov 05 08:42:53 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d234ad-491a-4d92-abac-d82982702f89 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b is being set with open permissions: ugo+rw Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b Nov 05 08:42:53 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b Nov 05 08:42:53 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info Nov 05 08:42:54 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f.37a87b0f-975a-4d15-b13b-26a7adda004b" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-37a87b0f-975a-4d15-b13b-26a7adda004b" released by "_delete_snapshot" :: held 1.441s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" released by "delete_snapshot" :: held 1.462s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Created reservations ['7f8a4e6b-338f-4efe-9376-ec4f2979cdf8', '429c2faa-aec1-44c1-acdf-b4f197a0230b', 'b3225681-884a-4a7b-89e1-90c3340f3a73', 'da5299e9-4874-4339-9cec-0f934c49fc05'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Delete snapshot completed successfully. Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-76592485-0355-40d3-b436-4d61223fca31 tempest-ProjectReaderTests-45298514 None] Lock "cinder-37a87b0f-975a-4d15-b13b-26a7adda004b-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info" returned: 0 in 0.282s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info is being set with open permissions: ugo+rw Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info Nov 05 08:42:54 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.info" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:54 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-dda66237-1481-42db-aa79-f83c82658e2c tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-596b445d-6d18-4ef1-b37e-e77ea9f3e25b-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-4f11201a-5397-443a-b09f-6e2d28d7fb8f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-596b445d-6d18-4ef1-b37e-e77ea9f3e25b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "cinder-4f11201a-5397-443a-b09f-6e2d28d7fb8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-596b445d-6d18-4ef1-b37e-e77ea9f3e25b" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-596b445d-6d18-4ef1-b37e-e77ea9f3e25b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot 596b445d-6d18-4ef1-b37e-e77ea9f3e25b of volume 36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5345d-2bcc-4701-b1b2-7f9c3e9e3900]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e20be0-80b8-49eb-b1f6-e726c679a69f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:54 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b Nov 05 08:42:55 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f Nov 05 08:42:55 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b" returned: 0 in 0.379s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d234ad-491a-4d92-abac-d82982702f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67de68c-ea01-44d0-88cf-f7f2fe4c6ee9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f" returned: 0 in 0.382s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f Nov 05 08:42:55 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 Nov 05 08:42:55 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-4f11201a-5397-443a-b09f-6e2d28d7fb8f" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-4f11201a-5397-443a-b09f-6e2d28d7fb8f" released by "delete_volume" :: held 0.712s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:55 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89" returned: 0 in 0.379s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Created reservations ['6b8c286a-dbef-4c9e-b864-71b71f274add', 'e9044bc3-ad8d-493c-9667-d328ef66cde3', 'cf53d35d-0d9a-4746-a8f0-71264b968190', '7d74b935-a5f0-41a4-9620-b10d9b62562f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:55 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b Nov 05 08:42:55 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:55 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:55 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Deleted volume successfully. Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-cf881cee-6ba2-4424-ade6-9a16a4247377 tempest-ProjectReaderTests-45298514 None] Lock "cinder-4f11201a-5397-443a-b09f-6e2d28d7fb8f-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b" returned: 0 in 0.371s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b Nov 05 08:42:56 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89.596b445d-6d18-4ef1-b37e-e77ea9f3e25b" returned: 0 in 0.269s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-596b445d-6d18-4ef1-b37e-e77ea9f3e25b" released by "_delete_snapshot" :: held 1.504s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" released by "delete_snapshot" :: held 1.528s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Created reservations ['dba13682-fc49-4660-aa14-650b94008262', 'e373dd99-cb4e-40d2-b283-5420f33e8596', '2812fcf7-c7b8-4613-89b1-66665ed745c2', 'cb7f6ac7-0cec-4f40-9a29-6f3da729b35f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (900acce4-ee71-43f0-8195-56ab80ed3d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324779e5-c5f9-4578-937c-24e7e6383de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324779e5-c5f9-4578-937c-24e7e6383de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595021008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41de6f37-c9b9-42cd-8459-22a03fbac313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:56Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac8eac8-7529-45fc-ad6a-e27782dbb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac8eac8-7529-45fc-ad6a-e27782dbb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f721aae-7b9b-4234-ad8a-038939abed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f721aae-7b9b-4234-ad8a-038939abed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41de6f37-c9b9-42cd-8459-22a03fbac313', 'volume_name': 'volume-41de6f37-c9b9-42cd-8459-22a03fbac313', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0f2a9-cce5-40a9-ae14-533fead88294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0f2a9-cce5-40a9-ae14-533fead88294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd19d22-d869-4a09-b92a-c4bfb8ebe2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:56 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Volume 41de6f37-c9b9-42cd-8459-22a03fbac313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41de6f37-c9b9-42cd-8459-22a03fbac313', 'volume_size': 1} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595021008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41de6f37-c9b9-42cd-8459-22a03fbac313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:56Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Creating volume 41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:56 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 1073741824 Nov 05 08:42:56 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-28ed4394-6b9b-451b-8b68-a37c43c17361 tempest-ProjectMemberTests-2076759849 None] Lock "cinder-596b445d-6d18-4ef1-b37e-e77ea9f3e25b-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-36d234ad-491a-4d92-abac-d82982702f89-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:56 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 1073741824" returned: 0 in 0.419s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "cinder-36d234ad-491a-4d92-abac-d82982702f89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" acquired by "delete_volume" :: waited 0.029s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:57 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 Nov 05 08:42:57 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d4ee2-7c0a-46a4-9bcd-4ad0afdba027]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 Nov 05 08:42:57 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd19d22-d869-4a09-b92a-c4bfb8ebe2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41de6f37-c9b9-42cd-8459-22a03fbac313', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeda9e1-5524-4174-926e-fd5656512ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:57 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Volume volume-41de6f37-c9b9-42cd-8459-22a03fbac313 (41de6f37-c9b9-42cd-8459-22a03fbac313): created successfully Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeda9e1-5524-4174-926e-fd5656512ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (900acce4-ee71-43f0-8195-56ab80ed3d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:57 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-ced1d858-8987-40c3-ad10-b4a0e69bca79 tempest-ProjectReaderTests-45298514 None] Created volume successfully. Nov 05 08:42:57 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89" returned: 0 in 0.377s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89 Nov 05 08:42:57 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-36d234ad-491a-4d92-abac-d82982702f89" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-36d234ad-491a-4d92-abac-d82982702f89" released by "delete_volume" :: held 0.696s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Created reservations ['dedd2842-56ee-4120-b00f-720f406249cd', '076446ff-7af2-425a-bf06-0de647574ee7', '95902d59-694f-4b94-adfd-68a1bec5a219', '69495fa7-7250-446a-bda8-4fb61d96c93d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:57 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:42:57 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:58 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.250s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:58 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d723680b-3481-420f-b292-05cca167cf8c tempest-ProjectMemberTests-2076759849 None] Lock "cinder-36d234ad-491a-4d92-abac-d82982702f89-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (1343992c-20e0-4812-9620-6eb8bf21220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f092efcf-eac4-40f2-976a-3b37d29b91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f092efcf-eac4-40f2-976a-3b37d29b91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311712305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d9cde2-232a-40fe-b50a-283786b864c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:59Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1793a37-fd97-4a2c-bf9c-55970dd0d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1793a37-fd97-4a2c-bf9c-55970dd0d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2b613c-d2dc-4a72-80ea-cc982bbf155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2b613c-d2dc-4a72-80ea-cc982bbf155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d9cde2-232a-40fe-b50a-283786b864c2', 'volume_name': 'volume-69d9cde2-232a-40fe-b50a-283786b864c2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fcd1c5-77ad-4e5f-bf5f-08d2204bb583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fcd1c5-77ad-4e5f-bf5f-08d2204bb583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f61068-561d-4495-9c11-64958be45c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Volume 69d9cde2-232a-40fe-b50a-283786b864c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d9cde2-232a-40fe-b50a-283786b864c2', 'volume_size': 1} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311712305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d9cde2-232a-40fe-b50a-283786b864c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b6926bbd84ea0bd2b48618d97c533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:59Z,use_quota=True,user_id='38b66a3cc00f41d5a054924f15fc69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Creating volume 69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:58 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:58 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 1073741824 Nov 05 08:42:58 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:58 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:59 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 1073741824" returned: 0 in 0.409s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 Nov 05 08:42:59 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2" returned: 0 in 0.239s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.645s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f61068-561d-4495-9c11-64958be45c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d9cde2-232a-40fe-b50a-283786b864c2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81dcb0a-7cd9-4164-af96-f84ee76c669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Creating offline snapshot 43b448fc-ee23-49e9-a646-eebc004b74b0 of volume 41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:59 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Volume volume-69d9cde2-232a-40fe-b50a-283786b864c2 (69d9cde2-232a-40fe-b50a-283786b864c2): created successfully Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81dcb0a-7cd9-4164-af96-f84ee76c669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Flow 'volume_create_manager' (1343992c-20e0-4812-9620-6eb8bf21220d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a65eb-4bef-4fe6-a476-803e13177a63]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-4012e26f-3d1a-4c86-b869-c59591552f8d tempest-ProjectMemberTests-2076759849 None] Created volume successfully. Nov 05 08:42:59 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 Nov 05 08:42:59 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:59 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313" returned: 0 in 0.374s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 1G Nov 05 08:42:59 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 1G" returned: 0 in 0.392s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de6f37-c9b9-42cd-8459-22a03fbac313 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:00 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de6f37-c9b9-42cd-8459-22a03fbac313 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 Nov 05 08:43:00 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de6f37-c9b9-42cd-8459-22a03fbac313 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0" returned: 0 in 0.295s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 is being set with open permissions: ugo+rw Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:00 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 Nov 05 08:43:00 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0" returned: 0 in 0.239s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:00 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info Nov 05 08:43:00 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info is being set with open permissions: ugo+rw Nov 05 08:43:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info Nov 05 08:43:01 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.info" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.514s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Creating offline snapshot d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 of volume 69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b1571-a6c5-4353-a18d-4a63c74cf49f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7fbabfd3-ee6f-4dbf-8acf-109ab1f5b0b6 tempest-ProjectReaderTests-45298514 None] Create snapshot completed successfully Nov 05 08:43:01 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 Nov 05 08:43:01 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 1G Nov 05 08:43:01 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-43b448fc-ee23-49e9-a646-eebc004b74b0-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-43b448fc-ee23-49e9-a646-eebc004b74b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-43b448fc-ee23-49e9-a646-eebc004b74b0" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-43b448fc-ee23-49e9-a646-eebc004b74b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Deleting offline snapshot 43b448fc-ee23-49e9-a646-eebc004b74b0 of volume 41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] snapshot_file for this snap is: volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[b027b58f-59f3-448b-846f-f8d577d531f3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 Nov 05 08:43:02 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 1G" returned: 0 in 0.446s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d9cde2-232a-40fe-b50a-283786b864c2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d9cde2-232a-40fe-b50a-283786b864c2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 Nov 05 08:43:02 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0" returned: 0 in 0.361s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41de6f37-c9b9-42cd-8459-22a03fbac313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a40ddc-72c2-4d0a-9fd4-5126c1dac8cf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d9cde2-232a-40fe-b50a-283786b864c2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" returned: 0 in 0.301s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 is being set with open permissions: ugo+rw Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 Nov 05 08:43:02 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 Nov 05 08:43:02 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info Nov 05 08:43:02 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313" returned: 0 in 0.407s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 Nov 05 08:43:02 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info" returned: 0 in 0.254s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info is being set with open permissions: ugo+rw Nov 05 08:43:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info Nov 05 08:43:02 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:03 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0" returned: 0 in 0.333s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:03 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0 Nov 05 08:43:03 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:03 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.info" returned: 0 in 0.237s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f5be88dc-991a-4a3d-a346-bda1294502b4 tempest-ProjectMemberTests-2076759849 None] Create snapshot completed successfully Nov 05 08:43:03 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313.43b448fc-ee23-49e9-a646-eebc004b74b0" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-43b448fc-ee23-49e9-a646-eebc004b74b0" released by "_delete_snapshot" :: held 1.455s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" released by "delete_snapshot" :: held 1.479s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Created reservations ['0697ce29-b3af-4fc1-b8c6-8343ba9fc98d', '38016fdb-f888-4e27-a20d-c50de92a72e0', '1b5df620-9f89-45ba-a29e-65ffba7012bc', 'c64e258d-585e-43b6-8d94-d8d2db218bdb'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Delete snapshot completed successfully. Nov 05 08:43:03 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-19f93377-be3c-41a9-81c3-b619578035f9 tempest-ProjectReaderTests-45298514 None] Lock "cinder-43b448fc-ee23-49e9-a646-eebc004b74b0-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-41de6f37-c9b9-42cd-8459-22a03fbac313-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "cinder-41de6f37-c9b9-42cd-8459-22a03fbac313-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Deleting offline snapshot d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 of volume 69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] snapshot_file for this snap is: volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" acquired by "delete_volume" :: waited 0.035s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f611bf0-5f6a-4f16-9094-19ed4910d5ff]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a6422-face-4d6a-a30f-26396afa71b6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 Nov 05 08:43:04 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 Nov 05 08:43:04 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313" returned: 0 in 0.351s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" returned: 0 in 0.380s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d9cde2-232a-40fe-b50a-283786b864c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:04 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313 Nov 05 08:43:04 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fd1b86-f9a3-4b2f-870f-90ae30d8e97c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 Nov 05 08:43:04 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-41de6f37-c9b9-42cd-8459-22a03fbac313" returned: 0 in 0.251s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-41de6f37-c9b9-42cd-8459-22a03fbac313" released by "delete_volume" :: held 0.670s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Created reservations ['39d5a468-463a-45f5-86f1-905886e06a26', 'ef2cafc5-d651-455c-9eec-3935268130fd', '31bf2b75-ee9a-43fc-bfaf-e5c780010c42', '871b125d-b540-4456-910b-bc6ff6c550f0'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:04 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2" returned: 0 in 0.384s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 Nov 05 08:43:05 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.270s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Deleted volume successfully. Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-e47424cd-6fa5-4a30-9258-9ac3f1e1245a tempest-ProjectReaderTests-45298514 None] Lock "cinder-41de6f37-c9b9-42cd-8459-22a03fbac313-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:05 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" returned: 0 in 0.350s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42 Nov 05 08:43:05 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2.d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" returned: 0 in 0.284s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42" released by "_delete_snapshot" :: held 1.530s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" released by "delete_snapshot" :: held 1.561s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (84d8d65e-88a1-4bdc-976f-0b8a3b61eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e459306-3bc3-4d82-88c4-7ed2d2c648e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e459306-3bc3-4d82-88c4-7ed2d2c648e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752136216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ac3d9-92c6-4d4c-b106-fa54eaf46fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:06Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0da51bc-ba9b-4200-a99d-5afb0f0652e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0da51bc-ba9b-4200-a99d-5afb0f0652e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d841e19-5532-4730-b000-9f7276d77427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d841e19-5532-4730-b000-9f7276d77427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476ac3d9-92c6-4d4c-b106-fa54eaf46fca', 'volume_name': 'volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8160241d-0996-4000-8309-4682b88079c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8160241d-0996-4000-8309-4682b88079c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c89fa2c-7638-46b9-8e4f-877baa42bda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:05 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Volume 476ac3d9-92c6-4d4c-b106-fa54eaf46fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca', 'volume_size': 1} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752136216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ac3d9-92c6-4d4c-b106-fa54eaf46fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:06Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Creating volume 476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:05 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca 1073741824 Nov 05 08:43:05 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Created reservations ['1d62d364-313f-4657-9b02-13dc3a759d0e', '995edd14-4f54-4f4f-9cba-3d001d6abaee', '260c9aca-8374-4203-b5bf-8d5dfa7d69b7', '7e2c4936-6efe-4436-b89d-ba0e0334fd12'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:05 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Delete snapshot completed successfully. Nov 05 08:43:05 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7a38ab7e-470e-4f47-a657-3c03c7bc7e9d tempest-ProjectMemberTests-2076759849 None] Lock "cinder-d52d05fd-ea2c-4fef-8ec4-a6fe9cbdec42-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-69d9cde2-232a-40fe-b50a-283786b864c2-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-69d9cde2-232a-40fe-b50a-283786b864c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:06 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca 1073741824" returned: 0 in 0.469s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9fa610-70d0-428d-a1fe-0fcb91e66d96]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca Nov 05 08:43:06 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 Nov 05 08:43:06 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" returned: 0 in 0.256s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c89fa2c-7638-46b9-8e4f-877baa42bda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffe9d15-ebcb-466d-a5e0-55e053ba51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:06 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Volume volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca (476ac3d9-92c6-4d4c-b106-fa54eaf46fca): created successfully Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffe9d15-ebcb-466d-a5e0-55e053ba51e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (84d8d65e-88a1-4bdc-976f-0b8a3b61eb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:06 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-f75d21db-e1a4-4cd3-9ccc-b499c5ef4025 tempest-ProjectReaderTests-45298514 None] Created volume successfully. Nov 05 08:43:06 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2" returned: 0 in 0.382s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2 Nov 05 08:43:06 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:07 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-69d9cde2-232a-40fe-b50a-283786b864c2" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-quobyte-69d9cde2-232a-40fe-b50a-283786b864c2" released by "delete_volume" :: held 0.689s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Created reservations ['b4b22399-b3eb-4f41-a5a5-7b660b7cf3be', 'bbaa0db5-1aab-423e-a904-fc977f5cadcc', '1d3dbf02-3f94-4461-a7d5-4218edaf89f9', 'e0f5fe62-5dcf-4321-86bb-be3d7a1fcf9d'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:07 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:07 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:07 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:07 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Deleted volume successfully. Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-5b92bcbc-790e-415a-bb73-394705e2022f tempest-ProjectMemberTests-2076759849 None] Lock "cinder-69d9cde2-232a-40fe-b50a-283786b864c2-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Creating offline snapshot ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff of volume 476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[49018366-27c0-4e2e-924c-803f70001fde]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:07 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca Nov 05 08:43:08 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:08 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" returned: 0 in 0.399s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff 1G Nov 05 08:43:08 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:08 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff 1G" returned: 0 in 0.439s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:08 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff Nov 05 08:43:08 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" returned: 0 in 0.326s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff is being set with open permissions: ugo+rw Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:09 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff Nov 05 08:43:09 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:09 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info Nov 05 08:43:09 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info is being set with open permissions: ugo+rw Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:09 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info Nov 05 08:43:09 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.info" returned: 0 in 0.245s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:10 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-52105bdb-f6ba-4899-be8a-c8e60a7bba03 tempest-ProjectReaderTests-45298514 None] Create snapshot completed successfully Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Deleting offline snapshot ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff of volume 476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] snapshot_file for this snap is: volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[78169ed7-81b7-400e-adcc-80d1d0119b4b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff Nov 05 08:43:11 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" returned: 0 in 0.357s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd10b5-e69e-4dbb-a8ca-4ded2b902879]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca Nov 05 08:43:11 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" returned: 0 in 0.360s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:12 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff Nov 05 08:43:12 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:12 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" returned: 0 in 0.365s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:12 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff Nov 05 08:43:12 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:12 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca.ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff" released by "_delete_snapshot" :: held 1.447s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" released by "delete_snapshot" :: held 1.509s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Created reservations ['a40f0505-366c-4880-aa0d-9494bae55f4f', '412a6dfa-aaa6-4bba-87d8-069b81255908', '8744c6eb-d43f-4bde-be49-fda24af6402e', '7b9a4205-a52e-4e77-9699-8fde7a597ba9'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:12 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Delete snapshot completed successfully. Nov 05 08:43:12 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-51e0de95-4b02-4dae-b26d-c10f06801aef tempest-ProjectReaderTests-45298514 None] Lock "cinder-ec775fc6-f2f5-4ad9-b4a5-d1e7fc5e48ff-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-476ac3d9-92c6-4d4c-b106-fa54eaf46fca-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "cinder-476ac3d9-92c6-4d4c-b106-fa54eaf46fca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204e60d-90c0-4cd9-be19-fac8e73bb092]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:13 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca Nov 05 08:43:13 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:13 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" returned: 0 in 0.353s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:13 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca Nov 05 08:43:13 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:13 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-476ac3d9-92c6-4d4c-b106-fa54eaf46fca" released by "delete_volume" :: held 0.658s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Created reservations ['a787a693-b58c-4184-875d-a06f651a336b', 'f99b5649-e298-47c0-af6a-165391ecfa59', '1019106a-322e-468f-9bd9-ca6326487c08', 'b0b78cfe-8070-4463-88cf-afb1153e315c'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:14 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:14 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:14 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.268s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Deleted volume successfully. Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-fd62a49f-b7d1-40df-97f7-91de6df4c806 tempest-ProjectReaderTests-45298514 None] Lock "cinder-476ac3d9-92c6-4d4c-b106-fa54eaf46fca-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (4b66cfb2-9fbf-44e2-8166-ca494da5975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6899b7cc-6d61-4e7c-b014-45c6f9c3f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6899b7cc-6d61-4e7c-b014-45c6f9c3f83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292217105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c1afc7-d404-4b55-be44-a1600f99edb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:15Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:14 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866943f0-2a63-446f-95ea-e4fa182bfb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866943f0-2a63-446f-95ea-e4fa182bfb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc70ff2e-01ae-4541-9b95-025dec562219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc70ff2e-01ae-4541-9b95-025dec562219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c1afc7-d404-4b55-be44-a1600f99edb2', 'volume_name': 'volume-f3c1afc7-d404-4b55-be44-a1600f99edb2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba4bde-f4f5-4043-9fac-3397e9ca4463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba4bde-f4f5-4043-9fac-3397e9ca4463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7ef4d7-d70f-4c78-ac15-87852f1eaabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Volume f3c1afc7-d404-4b55-be44-a1600f99edb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c1afc7-d404-4b55-be44-a1600f99edb2', 'volume_size': 1} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292217105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c1afc7-d404-4b55-be44-a1600f99edb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14ac835df794bac949d548cc7f33648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:15Z,use_quota=True,user_id='0821117269084091a9824301bdf8d9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Creating volume f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:15 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 1073741824 Nov 05 08:43:15 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 1073741824" returned: 0 in 0.445s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:DELETE=16,cinder:UPDATE=230,cinder:SELECT=166,cinder:INSERT=63 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 Nov 05 08:43:15 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2" returned: 0 in 0.249s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7ef4d7-d70f-4c78-ac15-87852f1eaabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c1afc7-d404-4b55-be44-a1600f99edb2', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23ebcf-1969-4d08-8dbb-efb7cadb9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=223,cinder:DELETE=20,cinder:SELECT=185,cinder:INSERT=63 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:15 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Volume volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 (f3c1afc7-d404-4b55-be44-a1600f99edb2): created successfully Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23ebcf-1969-4d08-8dbb-efb7cadb9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:15 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Flow 'volume_create_manager' (4b66cfb2-9fbf-44e2-8166-ca494da5975f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-e5138564-aa36-4b1c-a9fb-102c24e18b20 tempest-ProjectReaderTests-45298514 None] Created volume successfully. Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Creating offline snapshot 068622f7-c784-4e4a-9a24-ddc259c5a967 of volume f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[392be219-8086-4011-b040-b12dd8ed5e3a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 Nov 05 08:43:16 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2" returned: 0 in 0.373s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 1G Nov 05 08:43:16 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 1G" returned: 0 in 0.430s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 Nov 05 08:43:17 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967" returned: 0 in 0.313s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:17 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 is being set with open permissions: ugo+rw Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 Nov 05 08:43:17 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967" returned: 0 in 0.263s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info Nov 05 08:43:17 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:17 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info is being set with open permissions: ugo+rw Nov 05 08:43:17 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info Nov 05 08:43:17 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:18 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.info" returned: 0 in 0.252s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:18 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8e6bdd18-1ddb-43d7-a791-ef9bf065224a tempest-ProjectReaderTests-45298514 None] Create snapshot completed successfully Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-068622f7-c784-4e4a-9a24-ddc259c5a967-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-068622f7-c784-4e4a-9a24-ddc259c5a967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-068622f7-c784-4e4a-9a24-ddc259c5a967" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-068622f7-c784-4e4a-9a24-ddc259c5a967" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Deleting offline snapshot 068622f7-c784-4e4a-9a24-ddc259c5a967 of volume f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] snapshot_file for this snap is: volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4305db-9a3d-40a4-a148-e8c359b65f1f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 Nov 05 08:43:18 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:18 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967" returned: 0 in 0.403s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3c1afc7-d404-4b55-be44-a1600f99edb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed57ced-3ee5-45d1-a65a-4a6446c3c3ca]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:18 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 Nov 05 08:43:18 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:19 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2" returned: 0 in 0.373s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:19 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 Nov 05 08:43:19 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:19 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967" returned: 0 in 0.356s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:19 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967 Nov 05 08:43:19 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:19 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2.068622f7-c784-4e4a-9a24-ddc259c5a967" returned: 0 in 0.252s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-068622f7-c784-4e4a-9a24-ddc259c5a967" released by "_delete_snapshot" :: held 1.493s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" released by "delete_snapshot" :: held 1.518s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:19 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Created reservations ['3f652da4-4046-41ba-98d8-c5e8cadcb2ea', '33d46b2e-6c9f-4887-849d-07981669a5fd', 'baba55ba-b72f-437c-895c-5d6b3acdb0ff', '1c35b2fa-c77c-4a0e-9531-97a67088a213'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:20 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Delete snapshot completed successfully. Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-73bf8015-5300-4264-a7b3-5bdde94f6588 tempest-ProjectReaderTests-45298514 None] Lock "cinder-068622f7-c784-4e4a-9a24-ddc259c5a967-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-f3c1afc7-d404-4b55-be44-a1600f99edb2-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "cinder-f3c1afc7-d404-4b55-be44-a1600f99edb2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Acquiring lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" acquired by "delete_volume" :: waited 0.018s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[d040f1ca-1ba3-49ed-95e1-9c76c1061b26]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:20 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 Nov 05 08:43:20 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:21 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:21 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2 Nov 05 08:43:21 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:21 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-f3c1afc7-d404-4b55-be44-a1600f99edb2" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "cinder-quobyte-f3c1afc7-d404-4b55-be44-a1600f99edb2" released by "delete_volume" :: held 0.727s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Created reservations ['43f9bc60-f060-4d0c-af23-10f20b0dffb6', 'b73a8835-d976-4a75-8686-57baa3bc9021', '6928a6a2-3804-47e3-b30d-e317bd1443de', '452a607d-a03e-4c1b-ac19-4aa4c6c9bf51'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:21 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:21 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:21 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.266s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:21 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Deleted volume successfully. Nov 05 08:43:21 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-7f553096-12a6-4c7e-b332-0e7def05b085 tempest-ProjectReaderTests-45298514 None] Lock "cinder-f3c1afc7-d404-4b55-be44-a1600f99edb2-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (d030372d-6022-4b89-bff3-77e1c3a0921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82937ace-1517-44f4-9640-a71858e71e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82937ace-1517-44f4-9640-a71858e71e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240144959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0717456e-3ead-49c2-8148-2cfd5cff1781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:23Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d97671-754d-471f-85e2-5ff0a4846db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d97671-754d-471f-85e2-5ff0a4846db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3e28d1-7870-4571-b166-b7ebb99be98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3e28d1-7870-4571-b166-b7ebb99be98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0717456e-3ead-49c2-8148-2cfd5cff1781', 'volume_name': 'volume-0717456e-3ead-49c2-8148-2cfd5cff1781', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd37f3-25fc-4f4f-b40e-2e94f4d992be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd37f3-25fc-4f4f-b40e-2e94f4d992be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c976a2-0362-40a3-8224-ea3213be0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:23 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Volume 0717456e-3ead-49c2-8148-2cfd5cff1781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0717456e-3ead-49c2-8148-2cfd5cff1781', 'volume_size': 1} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240144959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0717456e-3ead-49c2-8148-2cfd5cff1781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:23Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Creating volume 0717456e-3ead-49c2-8148-2cfd5cff1781 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:23 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:23 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 1073741824 Nov 05 08:43:23 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:23 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 1073741824" returned: 0 in 0.456s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:23 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:23 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 Nov 05 08:43:23 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:24 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781" returned: 0 in 0.289s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c976a2-0362-40a3-8224-ea3213be0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0717456e-3ead-49c2-8148-2cfd5cff1781', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfeb4a6-ba9a-4314-93b4-72736bb59fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:24 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Volume volume-0717456e-3ead-49c2-8148-2cfd5cff1781 (0717456e-3ead-49c2-8148-2cfd5cff1781): created successfully Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfeb4a6-ba9a-4314-93b4-72736bb59fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:24 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (d030372d-6022-4b89-bff3-77e1c3a0921b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:24 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-fc7e544e-27c5-4be7-a8d1-d2d79e17758d tempest-ProjectReaderTests-1258254966 None] Created volume successfully. Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-0717456e-3ead-49c2-8148-2cfd5cff1781-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "cinder-0717456e-3ead-49c2-8148-2cfd5cff1781-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-quobyte-0717456e-3ead-49c2-8148-2cfd5cff1781" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-0717456e-3ead-49c2-8148-2cfd5cff1781" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9ab952-d0b8-41b2-a3cf-39884e777956]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:25 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 Nov 05 08:43:25 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:25 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781" returned: 0 in 0.354s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:25 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:25 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781 Nov 05 08:43:25 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:26 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-0717456e-3ead-49c2-8148-2cfd5cff1781" returned: 0 in 0.255s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-0717456e-3ead-49c2-8148-2cfd5cff1781" released by "delete_volume" :: held 0.658s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Created reservations ['e17788e6-6971-415b-8d06-c175db30afeb', '9fba4ee1-f6ba-4301-a303-c0b83aa2a4b8', '2a889294-8680-49b5-9f9e-b3ef6b050505', 'd6f05fbe-3238-48f4-b9b5-397bffd27c75'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:26 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:26 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:26 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.274s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:26 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Deleted volume successfully. Nov 05 08:43:26 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-9c4de9df-ce7c-4f9e-a456-096620f8f5aa tempest-ProjectReaderTests-1258254966 None] Lock "cinder-0717456e-3ead-49c2-8148-2cfd5cff1781-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (35a26696-5346-44cc-a51a-899ff4296a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7071375e-aca5-4024-9e82-c469be7dea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7071375e-aca5-4024-9e82-c469be7dea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472570165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588ea67d-4d22-4dd8-b48d-00437aaef02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:27Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34ddefb-f9fe-4c1b-91c4-699ce1ecfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34ddefb-f9fe-4c1b-91c4-699ce1ecfae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e73f9d-6369-48ac-8f29-8aa05c57f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e73f9d-6369-48ac-8f29-8aa05c57f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588ea67d-4d22-4dd8-b48d-00437aaef02f', 'volume_name': 'volume-588ea67d-4d22-4dd8-b48d-00437aaef02f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cb57fe-ebd7-4214-96ce-9b2cb9180d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cb57fe-ebd7-4214-96ce-9b2cb9180d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf01b6e-9174-4d6c-8b46-05544d317660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:27 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Volume 588ea67d-4d22-4dd8-b48d-00437aaef02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588ea67d-4d22-4dd8-b48d-00437aaef02f', 'volume_size': 1} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472570165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588ea67d-4d22-4dd8-b48d-00437aaef02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:27Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Creating volume 588ea67d-4d22-4dd8-b48d-00437aaef02f {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:27 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:27 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f 1073741824 Nov 05 08:43:27 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:27 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f 1073741824" returned: 0 in 0.414s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:27 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:27 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f Nov 05 08:43:27 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:28 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f" returned: 0 in 0.253s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf01b6e-9174-4d6c-8b46-05544d317660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588ea67d-4d22-4dd8-b48d-00437aaef02f', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa43c7a2-25d5-468a-8208-ada3063ca90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:28 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Volume volume-588ea67d-4d22-4dd8-b48d-00437aaef02f (588ea67d-4d22-4dd8-b48d-00437aaef02f): created successfully Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa43c7a2-25d5-468a-8208-ada3063ca90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:28 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (35a26696-5346-44cc-a51a-899ff4296a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:28 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-12545e87-c26c-42c0-8332-6da2d906f28d tempest-ProjectReaderTests-1258254966 None] Created volume successfully. Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-588ea67d-4d22-4dd8-b48d-00437aaef02f-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-588ea67d-4d22-4dd8-b48d-00437aaef02f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-quobyte-588ea67d-4d22-4dd8-b48d-00437aaef02f" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-588ea67d-4d22-4dd8-b48d-00437aaef02f" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[50731641-5c98-4d6e-82e5-d821fabd5dea]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:29 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f Nov 05 08:43:29 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:29 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f" returned: 0 in 0.351s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:29 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:29 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f Nov 05 08:43:29 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:30 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-588ea67d-4d22-4dd8-b48d-00437aaef02f" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-588ea67d-4d22-4dd8-b48d-00437aaef02f" released by "delete_volume" :: held 0.651s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Created reservations ['c24fe70f-6e6f-475a-923c-b7a001d60b37', '6899e7ac-1592-4da7-a26b-b0e1ccf90586', 'e351627d-fdb2-4164-8809-d138d581bbb5', 'bb8a143c-2a1d-4706-9a62-cab061033284'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:30 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:30 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:30 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.257s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:30 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Deleted volume successfully. Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02e65d0c-f398-4f3d-b2f2-defe5ae51f17 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-588ea67d-4d22-4dd8-b48d-00437aaef02f-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (ce9236a0-cc93-458e-a908-3f4033f7d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf9fb9-43a5-45b8-850e-c68b17d186f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf9fb9-43a5-45b8-850e-c68b17d186f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110724788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3777d50-0cad-4d97-ac84-00cbfacebcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:31Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bb9268-78d4-4a89-9200-9c82bbe37650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bb9268-78d4-4a89-9200-9c82bbe37650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:30 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672836e8-0163-4101-b68c-0074f21a78a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672836e8-0163-4101-b68c-0074f21a78a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3777d50-0cad-4d97-ac84-00cbfacebcbe', 'volume_name': 'volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6276b12c-06fc-4b47-ab1d-f99ef1a9e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6276b12c-06fc-4b47-ab1d-f99ef1a9e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d589296c-3bd4-423e-82af-309d3b876eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Volume d3777d50-0cad-4d97-ac84-00cbfacebcbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe', 'volume_size': 1} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110724788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3777d50-0cad-4d97-ac84-00cbfacebcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:31Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Creating volume d3777d50-0cad-4d97-ac84-00cbfacebcbe {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:31 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:31 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe 1073741824 Nov 05 08:43:31 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:31 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe 1073741824" returned: 0 in 0.488s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:31 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe Nov 05 08:43:31 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:31 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d589296c-3bd4-423e-82af-309d3b876eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a83a90-5b09-4fbb-8a7b-376fefdc001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:31 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Volume volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe (d3777d50-0cad-4d97-ac84-00cbfacebcbe): created successfully Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a83a90-5b09-4fbb-8a7b-376fefdc001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:31 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (ce9236a0-cc93-458e-a908-3f4033f7d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:31 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-56e7c730-a343-4537-bc0e-f56ee1977f72 tempest-ProjectReaderTests-1258254966 None] Created volume successfully. Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-d3777d50-0cad-4d97-ac84-00cbfacebcbe-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-d3777d50-0cad-4d97-ac84-00cbfacebcbe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-quobyte-d3777d50-0cad-4d97-ac84-00cbfacebcbe" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-d3777d50-0cad-4d97-ac84-00cbfacebcbe" acquired by "delete_volume" :: waited 0.017s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d26735-7e07-4b0b-b8c4-bfac9d99e122]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:33 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe Nov 05 08:43:33 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:33 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe" returned: 0 in 0.352s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:33 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe Nov 05 08:43:33 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:33 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3777d50-0cad-4d97-ac84-00cbfacebcbe" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-d3777d50-0cad-4d97-ac84-00cbfacebcbe" released by "delete_volume" :: held 0.635s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Created reservations ['36a16e04-6326-4ceb-8535-462f244651d3', '7b608e7f-c95b-44b5-b9b6-deff14961aba', '0960347f-7324-4212-bc82-9c00fb460d21', 'b7e0dee7-d627-4aa1-8ae9-c71463f65c78'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:33 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:33 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:33 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:34 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.239s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:34 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Deleted volume successfully. Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d2adbee3-ba2e-46c0-9a11-43f9aa219bf0 tempest-ProjectReaderTests-1258254966 None] Lock "cinder-d3777d50-0cad-4d97-ac84-00cbfacebcbe-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (cf670912-df8e-47c6-9693-6ae17b1dedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeab85ee-ce63-400f-957d-593f1dca671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeab85ee-ce63-400f-957d-593f1dca671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324422280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34fd171-5d12-409c-9f96-843dc9ebf884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:35Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc7d626-050a-4c5a-aae8-3028e753264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc7d626-050a-4c5a-aae8-3028e753264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b709426-fcb1-4e14-b643-b1a5acf62d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b709426-fcb1-4e14-b643-b1a5acf62d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34fd171-5d12-409c-9f96-843dc9ebf884', 'volume_name': 'volume-d34fd171-5d12-409c-9f96-843dc9ebf884', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb209fa4-8420-4fbc-a5f6-f59de6442d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb209fa4-8420-4fbc-a5f6-f59de6442d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb7a235-cf56-4c04-b37e-8a51edf69767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:34 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Volume d34fd171-5d12-409c-9f96-843dc9ebf884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34fd171-5d12-409c-9f96-843dc9ebf884', 'volume_size': 1} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324422280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34fd171-5d12-409c-9f96-843dc9ebf884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe8f9713ca4947ad7c9727c4f55df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:35Z,use_quota=True,user_id='ec65b289bfba465891aba81e2fac5ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Creating volume d34fd171-5d12-409c-9f96-843dc9ebf884 {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:34 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:43:34 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:34 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 1073741824 Nov 05 08:43:34 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:35 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 1073741824" returned: 0 in 0.402s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:35 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 Nov 05 08:43:35 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:35 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb7a235-cf56-4c04-b37e-8a51edf69767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34fd171-5d12-409c-9f96-843dc9ebf884', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f631cceb-ef8c-4348-b9f5-667d7e7797d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:35 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Volume volume-d34fd171-5d12-409c-9f96-843dc9ebf884 (d34fd171-5d12-409c-9f96-843dc9ebf884): created successfully Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f631cceb-ef8c-4348-b9f5-667d7e7797d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Flow 'volume_create_manager' (cf670912-df8e-47c6-9693-6ae17b1dedcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:35 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-a960bd41-e67c-4265-a7dd-dcbb570c6057 tempest-ProjectReaderTests-1258254966 None] Created volume successfully. Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-d34fd171-5d12-409c-9f96-843dc9ebf884-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "cinder-d34fd171-5d12-409c-9f96-843dc9ebf884-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Acquiring lock "cinder-quobyte-d34fd171-5d12-409c-9f96-843dc9ebf884" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-d34fd171-5d12-409c-9f96-843dc9ebf884" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f8d9d-adb6-4896-af04-e27f1a3ff033]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:35 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:35 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 Nov 05 08:43:35 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:36 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884" returned: 0 in 0.383s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:36 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884 Nov 05 08:43:36 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:36 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d34fd171-5d12-409c-9f96-843dc9ebf884" returned: 0 in 0.241s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "cinder-quobyte-d34fd171-5d12-409c-9f96-843dc9ebf884" released by "delete_volume" :: held 0.665s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Created reservations ['a4b76fba-1c59-41fc-bef1-9323e7d8d5a5', 'd4b521c0-ae0c-41d9-b290-78cd1404f8c5', 'b0bc7ef9-58f5-41d1-8fe8-dfaefa116db0', 'a55852eb-5232-4b63-a332-193373573159'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:36 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:36 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:36 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.240s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:36 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Deleted volume successfully. Nov 05 08:43:36 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-d50741ca-7455-4f57-95ed-7fa30ad1222b tempest-ProjectReaderTests-1258254966 None] Lock "cinder-d34fd171-5d12-409c-9f96-843dc9ebf884-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:46 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=42,cinder:UPDATE=60,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:46 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=60,cinder:DELETE=6,cinder:SELECT=38,cinder:INSERT=13 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:48 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:43:48 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:48 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.318s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG oslo_service.periodic_task [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] Running periodic task VolumeManager._thread_info {{(pid=87101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread count: 28 {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:43:48 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-2986d582-826e-4102-baff-001bdb5ad5b4 None None] thread info: [<_MainThread(MainThread, started 129352824619136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Flow 'volume_create_manager' (54cf238f-af85-44e9-b4f5-894a0485f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d8fd87-9cc6-43f7-aa93-e963b57634a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d8fd87-9cc6-43f7-aa93-e963b57634a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904850048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3772326-01d7-414b-a7b0-50da9914955b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df2eb434254657a792228ab91834f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:00Z,use_quota=True,user_id='0baf74363e10462ca993741395fedc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedbc9e5-6706-47a3-8616-6545faafc073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedbc9e5-6706-47a3-8616-6545faafc073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff4b9f-fa40-49df-8234-acb84a4f1f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff4b9f-fa40-49df-8234-acb84a4f1f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3772326-01d7-414b-a7b0-50da9914955b', 'volume_name': 'volume-d3772326-01d7-414b-a7b0-50da9914955b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a538ca-5e1e-4874-914a-8958cb5abaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a538ca-5e1e-4874-914a-8958cb5abaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9e7722-4d46-40d3-b149-7b273ffacba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Volume d3772326-01d7-414b-a7b0-50da9914955b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3772326-01d7-414b-a7b0-50da9914955b', 'volume_size': 1} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904850048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3772326-01d7-414b-a7b0-50da9914955b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df2eb434254657a792228ab91834f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:00Z,use_quota=True,user_id='0baf74363e10462ca993741395fedc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)}" {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Creating volume d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:44:00 devstack cinder-volume[87101]: INFO cinder.volume.drivers.remotefs [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] casted to osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b 1073741824 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:00 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b 1073741824 Nov 05 08:44:00 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:00 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b 1073741824" returned: 0 in 0.411s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:00 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:00 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:00 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.236s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'} {{(pid=87101) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9e7722-4d46-40d3-b149-7b273ffacba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3772326-01d7-414b-a7b0-50da9914955b', 'volume_size': 1}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8aed13-1f16-4fb4-9940-d567ee7320e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:00 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Volume volume-d3772326-01d7-414b-a7b0-50da9914955b (d3772326-01d7-414b-a7b0-50da9914955b): created successfully Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8aed13-1f16-4fb4-9940-d567ee7320e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:00 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Flow 'volume_create_manager' (54cf238f-af85-44e9-b4f5-894a0485f397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:00 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-d9e97bc9-eace-4744-9e5d-d217cb60d7ca tempest-SnapshotDependencyTests-111751433 None] Created volume successfully. Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Creating offline snapshot 2d2d1af0-3600-4608-a5fe-f5dbe3991416 of volume d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac350caf-3002-4b12-8b3f-7ad98de6cee1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:01 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:01 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:01 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.348s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:01 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 1G {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:01 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 1G Nov 05 08:44:01 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:02 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 1G" returned: 0 in 0.398s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3772326-01d7-414b-a7b0-50da9914955b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3772326-01d7-414b-a7b0-50da9914955b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:02 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:02 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3772326-01d7-414b-a7b0-50da9914955b -F qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.285s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 is being set with open permissions: ugo+rw Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:02 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:02 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.244s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info Nov 05 08:44:02 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:02 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info" returned: 0 in 0.248s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:02 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info is being set with open permissions: ugo+rw Nov 05 08:44:02 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info Nov 05 08:44:02 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:03 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.info" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:03 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:03 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-2a1e8804-315f-4f86-87a8-facb487d0b47 tempest-SnapshotDependencyTests-111751433 None] Create snapshot completed successfully Nov 05 08:44:03 devstack cinder-volume[87101]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87101) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Flow 'volume_create_manager' (452c2b93-080e-4388-a1ff-79160b811588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a603f1-7251-42bb-a6ed-2858ed0f5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a603f1-7251-42bb-a6ed-2858ed0f5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1916f1d7-acb9-498c-9be1-724e7c7c5b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df2eb434254657a792228ab91834f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d2d1af0-3600-4608-a5fe-f5dbe3991416,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:04Z,use_quota=True,user_id='0baf74363e10462ca993741395fedc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35251d8a-2bfe-4a40-a417-a75ebfc7a7f2),volume_type_id=35251d8a-2bfe-4a40-a417-a75ebfc7a7f2)' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdc9c66-be7b-4d98-8b11-47ae9204e6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdc9c66-be7b-4d98-8b11-47ae9204e6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71941e40-277b-45b6-997f-c2c5c9dad73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71941e40-277b-45b6-997f-c2c5c9dad73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1916f1d7-acb9-498c-9be1-724e7c7c5b99', 'volume_name': 'volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99', 'volume_size': 1, 'snapshot_id': '2d2d1af0-3600-4608-a5fe-f5dbe3991416'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc217b-56f4-4f50-be0d-147ea9126b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc217b-56f4-4f50-be0d-147ea9126b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f304e-89f7-4101-a6d1-3022f7dd556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:04 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Volume 1916f1d7-acb9-498c-9be1-724e7c7c5b99: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99', 'volume_size': 1, 'snapshot_id': '2d2d1af0-3600-4608-a5fe-f5dbe3991416'} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416-1916f1d7-acb9-498c-9be1-724e7c7c5b99" by "_create_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416-1916f1d7-acb9-498c-9be1-724e7c7c5b99" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Creating volume 1916f1d7-acb9-498c-9be1-724e7c7c5b99 from snapshot 2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Selected osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61 as target Quobyte volume. {{(pid=87101) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" by "_copy_volume_from_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] snapshot: 2d2d1af0-3600-4608-a5fe-f5dbe3991416, volume: 1916f1d7-acb9-498c-9be1-724e7c7c5b99, {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[765e4ded-1caa-421b-81f6-b1135700db08]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:04 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.355s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3772326-01d7-414b-a7b0-50da9914955b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[be600a1f-3256-428d-b91d-9326fa9443bc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:04 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.345s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Creating direct copy from snapshot {{(pid=87101) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG cinder.utils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Path /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 not found in is_blk_device check {{(pid=87101) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:44:04 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 Nov 05 08:44:04 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:10 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99" returned: 0 in 5.807s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG cinder.image.image_utils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Image conversion details: src /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 {{(pid=87101) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:44:10 devstack cinder-volume[87101]: INFO cinder.image.image_utils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Converted 1024.00 MB image at 176.31 MB/s Nov 05 08:44:10 devstack cinder-volume[87101]: WARNING cinder.volume.drivers.remotefs [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 is being set with open permissions: ugo+rw Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:10 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 Nov 05 08:44:10 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:10 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99" returned: 0 in 0.238s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" released by "_copy_volume_from_snapshot" :: held 6.818s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416-1916f1d7-acb9-498c-9be1-724e7c7c5b99" released by "_create_volume_from_snapshot" :: held 6.877s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.892s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:10 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f304e-89f7-4101-a6d1-3022f7dd556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99', 'volume_size': 1, 'snapshot_id': '2d2d1af0-3600-4608-a5fe-f5dbe3991416'}' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd695b07-295a-4b90-9bbb-380041ac210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:11 devstack cinder-volume[87101]: INFO cinder.volume.flows.manager.create_volume [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Volume volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 (1916f1d7-acb9-498c-9be1-724e7c7c5b99): created successfully Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd695b07-295a-4b90-9bbb-380041ac210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87101) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Flow 'volume_create_manager' (452c2b93-080e-4388-a1ff-79160b811588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87101) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:11 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-02ffc371-1cb2-4a30-9e26-d9518f6d089c tempest-SnapshotDependencyTests-111751433 None] Created volume successfully. Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-2d2d1af0-3600-4608-a5fe-f5dbe3991416-delete_snapshot" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-2d2d1af0-3600-4608-a5fe-f5dbe3991416-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" by "delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416" by "_delete_snapshot" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Deleting offline snapshot 2d2d1af0-3600-4608-a5fe-f5dbe3991416 of volume d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] snapshot_file for this snap is: volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[6107f9d1-4c6a-4e51-86f5-30dfe8d598a8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:11 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:11 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:11 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.349s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.remotefs [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3772326-01d7-414b-a7b0-50da9914955b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87101) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb0ff22-ad26-496d-b4b6-edc81555a554]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:11 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:12 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:12 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:12 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.521s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:12 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:12 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:12 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.323s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:12 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:12 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416 Nov 05 08:44:12 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:13 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b.2d2d1af0-3600-4608-a5fe-f5dbe3991416" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-2d2d1af0-3600-4608-a5fe-f5dbe3991416" released by "_delete_snapshot" :: held 1.534s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" released by "delete_snapshot" :: held 1.556s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Created reservations ['b6f2b576-35ca-4ab8-bf2e-47f474afa701', '1752036f-5938-4405-b25c-d78e524cedd0', 'c5ab3341-6660-477d-aa53-a9ca57232c99', 'f7ccbdcb-d215-4c48-84fb-34e5700f833f'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:13 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Delete snapshot completed successfully. Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-83daa263-0a46-4aca-b231-68b242922f54 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-2d2d1af0-3600-4608-a5fe-f5dbe3991416-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-d3772326-01d7-414b-a7b0-50da9914955b-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-d3772326-01d7-414b-a7b0-50da9914955b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[316722dd-8f47-42c5-bb1e-1836ac2b332f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:13 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:13 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:13 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:14 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.369s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:14 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b Nov 05 08:44:14 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:14 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-d3772326-01d7-414b-a7b0-50da9914955b" returned: 0 in 0.246s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-d3772326-01d7-414b-a7b0-50da9914955b" released by "delete_volume" :: held 0.671s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Created reservations ['2864312d-a796-4c9a-8b65-28fe13f69154', '236b6ed7-eb57-4123-8d5e-cc9cf38b81c1', 'c39f3c16-a06c-4ddc-b0ea-6759a23abc27', '0a156cc9-fbdf-4289-b4d2-8c8258704c3e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:14 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:44:14 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:14 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.237s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:44:14 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Deleted volume successfully. Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-6669c730-4ca1-44f2-af55-4433126d3df5 tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-d3772326-01d7-414b-a7b0-50da9914955b-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-1916f1d7-acb9-498c-9be1-724e7c7c5b99-delete_volume" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-1916f1d7-acb9-498c-9be1-724e7c7c5b99-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" by "delete_volume" {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" acquired by "delete_volume" :: waited 0.014s {{(pid=87101) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo.privsep.daemon [-] privsep: reply[89554bb6-3716-4cbe-99f6-fc3144a47f54]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:14 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:15 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 Nov 05 08:44:15 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:15 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99" returned: 0 in 0.346s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:15 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99 Nov 05 08:44:15 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:15 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927/volume-1916f1d7-acb9-498c-9be1-724e7c7c5b99" returned: 0 in 0.242s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-quobyte-1916f1d7-acb9-498c-9be1-724e7c7c5b99" released by "delete_volume" :: held 0.631s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.quota [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Created reservations ['a995074c-d9c8-4e05-a04c-1164f0d6d4ff', '00e1ee1e-b414-4e6c-9c73-2a6d0eb99663', '91d6d417-738c-4d56-99ea-48de56276a79', 'b83d7100-43af-470a-8b0a-c67a77ad800e'] {{(pid=87101) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61': None} {{(pid=87101) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.volume.drivers.quobyte [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1379d1ba-ae9e-4451-af2a-505610ac2a61'] {{(pid=87101) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.lockutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87101) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:15 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927 Nov 05 08:44:15 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:15 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG oslo_concurrency.processutils [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360ac075f41419d7127c978165058927" returned: 0 in 0.233s {{(pid=87101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.manager [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Notifying Schedulers of capabilities ... {{(pid=87101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:44:15 devstack cinder-volume[87101]: INFO cinder.volume.manager [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Deleted volume successfully. Nov 05 08:44:15 devstack cinder-volume[87101]: DEBUG cinder.coordination [None req-8a456099-0889-4dfe-8858-f9d8e084547c tempest-SnapshotDependencyTests-111751433 None] Lock "cinder-1916f1d7-acb9-498c-9be1-724e7c7c5b99-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87101) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:44:27 devstack cinder-volume[87101]: DEBUG dbcounter [-] [87101] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}